Task 11652287

Name	famous_ubh8_1799_200_006647719_5
Workunit	6851091
Created	11 Aug 2010, 20:57:07 UTC
Sent	11 Aug 2010, 21:11:51 UTC
Report deadline	11 Nov 2010, 4:39:02 UTC
Received	9 Jan 2011, 21:40:10 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	942634
Run time
CPU time	1 days 2 hours 55 min 4 sec
Validate state	Invalid
Credit	710.36
Device peak FLOPS	3.28 GFLOPS
Application version	UK Met Office FAMOUS v6.11 windows_intelx86
Stderr	<core_client_version>6.2.18</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Signal 11 received, exiting... 20:51:18 (6360): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6428, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 20:51:23 (5836): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6428, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 20:54:07 (6260): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6428, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 20:58:30 (6364): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6428, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 20:59:13 (5148): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6428, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 21:00:15 (5164): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6428, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 21:07:13 (5536): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6428, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 21:10:43 (6548): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6428, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... 21:06:30 (6340): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6316, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 21:09:08 (1484): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6316, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 21:21:42 (6632): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6316, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 21:47:31 (6520): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6316, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 21:53:54 (6584): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6316, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... 17:05:51 (3468): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2268, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 17:48:54 (5872): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2268, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 17:52:08 (5084): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2268, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 18:08:19 (320): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2268, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 18:15:10 (3528): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2268, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 18:19:00 (3728): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2268, iMonCtr=1 Model crash detected, will try to restart... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... 21:54:07 (5760): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5060, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... 20:39:02 (2100): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3988, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 20:51:33 (1020): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3988, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 20:58:09 (6932): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3988, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 20:59:59 (6048): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3988, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 21:01:59 (6412): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3988, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 21:07:25 (560): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3988, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 21:24:11 (4408): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3988, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 21:27:03 (6500): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3988, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 21:35:18 (6884): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3988, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 21:38:34 (3584): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3988, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 21:46:44 (3580): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3988, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 21:47:38 (2984): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3988, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 21:50:55 (480): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3988, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 21:57:07 (3356): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3988, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 22:00:37 (4104): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3988, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 22:08:40 (6992): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3988, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 22:10:32 (2364): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3988, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 22:15:05 (2392): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3988, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 22:19:00 (6408): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3988, iMonCtr=1 Model crash detected, will try to restart... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Signal 11 received, exiting... 22:24:59 (3344): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3988, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 22:26:07 (3024): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3988, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 22:36:39 (4104): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3988, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 22:45:29 (6200): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3988, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 22:54:11 (5700): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3988, iMonCtr=1 Model crash detected, will try to restart... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Signal 11 received, exiting... 23:09:51 (6128): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3988, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 23:11:27 (3896): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3988, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 23:13:56 (6328): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3988, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... 18:21:12 (2404): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2336, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... 21:26:11 (4072): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4496, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... 23:08:23 (5772): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5048, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Sorry, too many model crashes! :-( 21:39:02 (5288): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
09 Jan 2011 20:41:57	942634	11652287	famous_ubh8_1799_200_006647719_5	215,306	93,519	0.4344
09 Jan 2011 20:30:52	942634	11652287	famous_ubh8_1799_200_006647719_5	205,946	89,692	0.4355
09 Jan 2011 20:30:52	942634	11652287	famous_ubh8_1799_200_006647719_5	196,586	85,930	0.4371
10 Dec 2010 21:04:22	942634	11652287	famous_ubh8_1799_200_006647719_5	187,226	82,139	0.4387
09 Dec 2010 21:46:02	942634	11652287	famous_ubh8_1799_200_006647719_5	177,866	78,357	0.4405
09 Dec 2010 20:38:46	942634	11652287	famous_ubh8_1799_200_006647719_5	168,506	74,637	0.4429
09 Dec 2010 19:31:39	942634	11652287	famous_ubh8_1799_200_006647719_5	159,146	70,892	0.4455
09 Dec 2010 18:28:57	942634	11652287	famous_ubh8_1799_200_006647719_5	149,786	67,148	0.4483
06 Dec 2010 21:04:34	942634	11652287	famous_ubh8_1799_200_006647719_5	140,426	63,376	0.4513
05 Dec 2010 19:40:33	942634	11652287	famous_ubh8_1799_200_006647719_5	131,066	59,287	0.4523
05 Dec 2010 18:31:41	942634	11652287	famous_ubh8_1799_200_006647719_5	121,706	55,348	0.4548
04 Dec 2010 22:19:28	942634	11652287	famous_ubh8_1799_200_006647719_5	112,346	50,419	0.4488
03 Dec 2010 11:40:15	942634	11652287	famous_ubh8_1799_200_006647719_5	102,986	44,733	0.4344
01 Dec 2010 22:01:35	942634	11652287	famous_ubh8_1799_200_006647719_5	93,626	40,665	0.4343
01 Dec 2010 20:42:21	942634	11652287	famous_ubh8_1799_200_006647719_5	84,266	36,147	0.4290
01 Dec 2010 17:47:44	942634	11652287	famous_ubh8_1799_200_006647719_5	74,906	32,171	0.4295
01 Dec 2010 16:55:40	942634	11652287	famous_ubh8_1799_200_006647719_5	65,546	28,428	0.4337
01 Dec 2010 16:55:40	942634	11652287	famous_ubh8_1799_200_006647719_5	56,186	24,611	0.4380
01 Dec 2010 16:55:40	942634	11652287	famous_ubh8_1799_200_006647719_5	46,826	20,822	0.4447
21 Nov 2010 17:54:36	942634	11652287	famous_ubh8_1799_200_006647719_5	37,466	16,789	0.4481