Task 11816113

Name	famous_vjni_1999_200_006711236_4
Workunit	6914489
Created	26 Aug 2010, 17:18:22 UTC
Sent	7 Nov 2010, 22:01:16 UTC
Report deadline	7 Feb 2011, 5:28:27 UTC
Received	10 Nov 2010, 15:36:44 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1093122
Run time	2 days 2 hours 20 min 44 sec
CPU time	1 days 20 hours 7 min 25 sec
Validate state	Invalid
Credit	1,204.47
Device peak FLOPS	2.27 GFLOPS
Application version	UK Met Office FAMOUS v6.11 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> 21:17:43 (3780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:48:56 (3240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:28:57 (900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Model crashed: TEMPHIST: Write ERROR on history file for namelistNLIHISTO tmp/pipe_dummy 00:27:17 (5292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:27:28 (5292): No heartbeat from core client for 30 sec - exiting 00:27:32 (5292): No heartbeat from core client for 30 sec - exiting 00:27:35 (5292): No heartbeat from core client for 30 sec - exiting 00:27:36 (5292): No heartbeat from core client for 30 sec - exiting 000:51:56 (5352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:21:40 (6012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:36:08 (4192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:36:16 (4192): No heartbeat from core client for 30 sec - exiting 01:36:18 (4192): No heartbeat from core client for 30 sec - exiting 01:57:27 (5752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Model crashed: TEMPHIST: Write ERROR on history file for namelistNLIHISTO tmp/pipe_dummy 02:28:40 (4844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:28:45 (4844): No heartbeat from core client for 30 sec - exiting 02:55:45 (6004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:55:59 (6004): No heartbeat from core client for 30 sec - exiting 06:25:11 (3096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:25:23 (3096): No heartbeat from core client for 30 sec - exiting 06:25:40 (3096): No heartbeat from core client for 30 sec - exiting 06:25:54 (3096): No heartbeat from core client for 30 sec - exiting 07:06:04 (7632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:06:31 (7632): No heartbeat from core client for 30 sec - exiting 07:06:35 (7632): No heartbeat from core client for 30 sec - exiting 08:06:03 (3408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:06:11 (3408): No heartbeat from core client for 30 sec - exiting 08:06:14 (3408): No heartbeat from core client for 30 sec - exiting 08:06:15 (3408): No heartbeat from core client for 30 sec - exiting 08:06:17 (3408): No heartbeat from core client for 30 sec - exiting 09:17:48 (3712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:38:22 (4752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Model crashed: TEMPHIST: Write ERROR on history file for namelistNLIHISTO tmp/pipe_dummy Model crashed: TEMPHIST: Write ERROR on history file for namelistNLIHISTO tmp/pipe_dummy Model crashed: TEMPHIST: Write ERROR on history file for namelistNLIHISTO tmp/pipe_dummy Model crashed: TEMPHIST: Write ERROR on history file for namelistNLIHISTO tmp/pipe_dummy Model crashed: TEMPHIST: Write ERROR on history file for namelistNLIHISTO tmp/pipe_dummy Model crashed: TEMPHIST: Write ERROR on history file for namelistNLIHISTO tmp/pipe_dummy Model crashed: TEMPHIST: Write ERROR on history file for namelistNLIHISTO tmp/pipe_dummy Model crashed: TEMPHIST: Write ERROR on history file for namelistNLIHISTO tmp/pipe_dummy Model crashed: TEMPHIST: Write ERROR on history file for namelistNLIHISTO tmp/pipe_dummy Model crashed: TEMPHIST: Write ERROR on history file for namelistNLIHISTO tmp/pipe_dummy Model crashed: TEMPHIST: Write ERROR on history file for namelistNLIHISTO tmp/pipe_dummy Model crashed: TEMPHIST: Write ERROR on history file for namelistNLIHISTO tmp/pipe_dummy Model crashed: TEMPHIST: Write ERROR on history file for namelistNLIHISTO tmp/pipe_dummy Model crashed: TEMPHIST: Write ERROR on history file for namelistNLIHISTO tmp/pipe_dummy Model crashed: TEMPHIST: Write ERROR on history file for namelistNLIHISTO tmp/pipe_dummy 22:22:29 (5116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:22:41 (5116): No heartbeat from core client for 30 sec - exiting 22:22:54 (5116): No heartbeat from core client for 30 sec - exiting 2 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 04:50:11 (6864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:15:35 (3120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:24:39 (376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:24:47 (376): No heartbeat from core client for 30 sec - exiting 12:28:39 (7800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:35:41 (4384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:35:46 (4384): No heartbeat from core client for 30 sec - exiting 12:35:47 (4384): No heartbeat from core client for 30 sec - exiting 12:35:48 (4384): No heartbeat from core client for 30 sec - exiting 12:35:49 (4384): No heartbeat from core client for 30 sec - exiting 12:35:50 (4384): No heartbeat from core client for 30 sec - exiting 12:35:51 (4384): No heartbeat from core client for 30 sec - exiting 12:35:53 (4384): No heartbeat from core client for 30 sec - exiting 12:35:54 (4384): No heartbeat from core client for 30 sec - exiting 12:51:16 (5300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:51:23 (5300): No heartbeat from core client for 30 sec - exiting 12:55:38 (7992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:05:03 (6376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:05:29 (6376): No heartbeat from core client for 30 sec - exiting 13:05:30 (6376): No heartbeat from core client for 30 sec - exiting 13:05:31 (6376): No heartbeat from core client for 30 sec - exiting 13:12:22 (5888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:12:35 (5888): No heartbeat from core client for 30 sec - exiting 13:13:32 (5888): No heartbeat from core client for 30 sec - exiting 13:13:45 (5888): No heartbeat from core client for 30 sec - exiting 13:24:37 (6792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:25:00 (6792): No heartbeat from core client for 30 sec - exiting 13:25:07 (6792): No heartbeat from core client for 30 sec - exiting 13:25:15 (6792): No heartbeat from core client for 30 sec - exiting 13:25:16 (6792): No heartbeat from core client for 30 sec - exiting 13:29:08 (1296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:29:22 (1296): No heartbeat from core client for 30 sec - exiting 13:29:31 (1296): No heartbeat from core client for 30 sec - exiting 13:29:32 (1296): No heartbeat from core client for 30 sec - exiting 13:29:33 (1296): No heartbeat from core client for 30 sec - exiting 13:34:12 (3508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:34:30 (3508): No heartbeat from core client for 30 sec - exiting 13:34:35 (3508): No heartbeat from core client for 30 sec - exiting 13:34:37 (3508): No heartbeat from core client for 30 sec - exiting 13:43:52 (2024): No heartbeat from core client for 30 sec - exiting 13:44:00 (2024): No heartbeat from core client for 30 sec - exiting 13:44:04 (2024): No heartbeat from core client for 30 sec - exiting 13:44:05 (2024): No heartbeat from core client for 30 sec - exiting 13:44:09 (2024): No heartbeat from core client for 30 sec - exiting 13:44:11 (2024): No heartbeat from core client for 30 sec - exiting 13:44:16 (2024): No heartbeat from core client for 30 sec - exiting 13:44:17 (2024): No heartbeat from core client for 30 sec - exiting 13:46:37 (2024): No heartbeat from core client for 30 sec - exiting 13:49:13 (2024): No heartbeat from core client for 30 sec - exiting 13:49:16 (2024): No heartbeat from core client for 30 sec - exiting 13:49:17 (2024): No heartbeat from core client for 30 sec - exiting 13:49:19 (2024): No heartbeat from core client for 30 sec - exiting 13:51:53 (2024): No heartbeat from core client for 30 sec - exiting 13:51:56 (2024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:10:10 (7796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:10:17 (7796): No heartbeat from core client for 30 sec - exiting 14:10:21 (7796): No heartbeat from core client for 30 sec - exiting 14:29:43 (4128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:30:29 (4128): No heartbeat from core client for 30 sec - exiting 14:30:32 (4128): No heartbeat from core client for 30 sec - exiting 14:30:43 (4128): No heartbeat from core client for 30 sec - exiting 14:31:06 (4128): No heartbeat from core client for 30 sec - exiting 14:44:07 (7476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:45:23 (7476): No heartbeat from core client for 30 sec - exiting 14:45:26 (7476): No heartbeat from core client for 30 sec - exiting 14:45:27 (7476): No heartbeat from core client for 30 sec - exiting forrtl: severe (47): write to READONLY file, unit 6, file C:\ProgramData\BOINC\projects\climateprediction.net\famous_vjni_1999_200_006711236\dataout\stdout_um.txt Image PC Routine Line Source famous_um_6.11_wi 008846D2 Unknown Unknown Unknown Stack trace terminated abnormally. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4576, iMonCtr=1 Model crash detected, will try to restart... forrtl: severe (47): write to READONLY file, unit 6, file C:\ProgramData\BOINC\projects\climateprediction.net\famous_vjni_1999_200_006711236\dataout\stdout_um.txt Image PC Routine Line Source famous_um_6.11_wi 008846D2 Unknown Unknown Unknown Stack trace terminated abnormally. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4576, iMonCtr=1 Model crash detected, will try to restart... forrtl: severe (47): write to READONLY file, unit 6, file C:\ProgramData\BOINC\projects\climateprediction.net\famous_vjni_1999_200_006711236\dataout\stdout_um.txt Image PC Routine Line Source famous_um_6.11_wi 008846D2 Unknown Unknown Unknown Stack trace terminated abnormally. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4576, iMonCtr=1 Model crash detected, will try to restart... forrtl: severe (47): write to READONLY file, unit 6, file C:\ProgramData\BOINC\projects\climateprediction.net\famous_vjni_1999_200_006711236\dataout\stdout_um.txt Image PC Routine Line Source famous_um_6.11_wi 008846D2 Unknown Unknown Unknown Stack trace terminated abnormally. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4576, iMonCtr=1 Model crash detected, will try to restart... forrtl: severe (47): write to READONLY file, unit 6, file C:\ProgramData\BOINC\projects\climateprediction.net\famous_vjni_1999_200_006711236\dataout\stdout_um.txt Image PC Routine Line Source famous_um_6.11_wi 008846D2 Unknown Unknown Unknown Stack trace terminated abnormally. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4576, iMonCtr=1 Model crash detected, will try to restart... forrtl: severe (47): write to READONLY file, unit 6, file C:\ProgramData\BOINC\projects\climateprediction.net\famous_vjni_1999_200_006711236\dataout\stdout_um.txt Image PC Routine Line Source famous_um_6.11_wi 008846D2 Unknown Unknown Unknown Stack trace terminated abnormally. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4576, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( 14:46:59 (4576): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
10 Nov 2010 11:38:54	1093122	11816113	famous_vjni_1999_200_006711236_4	365,066	155,647	0.4264
10 Nov 2010 10:21:04	1093122	11816113	famous_vjni_1999_200_006711236_4	355,706	151,640	0.4263
10 Nov 2010 08:56:39	1093122	11816113	famous_vjni_1999_200_006711236_4	346,346	147,621	0.4262
10 Nov 2010 07:40:34	1093122	11816113	famous_vjni_1999_200_006711236_4	336,986	143,616	0.4262
10 Nov 2010 07:40:01	1093122	11816113	famous_vjni_1999_200_006711236_4	327,626	139,611	0.4261
10 Nov 2010 07:40:01	1093122	11816113	famous_vjni_1999_200_006711236_4	318,266	135,605	0.4261
10 Nov 2010 07:40:01	1093122	11816113	famous_vjni_1999_200_006711236_4	308,906	131,608	0.4260
10 Nov 2010 07:40:01	1093122	11816113	famous_vjni_1999_200_006711236_4	299,546	127,605	0.4260
10 Nov 2010 06:49:50	1093122	11816113	famous_vjni_1999_200_006711236_4	290,186	123,608	0.4260
09 Nov 2010 23:47:08	1093122	11816113	famous_vjni_1999_200_006711236_4	280,826	119,610	0.4259
09 Nov 2010 22:25:39	1093122	11816113	famous_vjni_1999_200_006711236_4	271,466	115,613	0.4259
09 Nov 2010 21:07:46	1093122	11816113	famous_vjni_1999_200_006711236_4	262,106	111,614	0.4258
09 Nov 2010 19:50:25	1093122	11816113	famous_vjni_1999_200_006711236_4	252,746	107,625	0.4258
09 Nov 2010 18:33:21	1093122	11816113	famous_vjni_1999_200_006711236_4	243,386	103,643	0.4258
09 Nov 2010 17:16:10	1093122	11816113	famous_vjni_1999_200_006711236_4	234,026	99,645	0.4258
09 Nov 2010 15:59:02	1093122	11816113	famous_vjni_1999_200_006711236_4	224,666	95,677	0.4259
09 Nov 2010 14:41:47	1093122	11816113	famous_vjni_1999_200_006711236_4	215,306	91,657	0.4257
09 Nov 2010 13:23:56	1093122	11816113	famous_vjni_1999_200_006711236_4	205,946	87,670	0.4257
09 Nov 2010 12:06:06	1093122	11816113	famous_vjni_1999_200_006711236_4	196,586	83,693	0.4257
09 Nov 2010 10:48:37	1093122	11816113	famous_vjni_1999_200_006711236_4	187,226	79,715	0.4258