Task 11881720

Name	famous_v46q_1899_200_006691192_6
Workunit	6894445
Created	11 Sep 2010, 17:31:38 UTC
Sent	11 Sep 2010, 17:40:31 UTC
Report deadline	12 Dec 2010, 1:07:42 UTC
Received	22 Oct 2010, 19:16:04 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1093122
Run time	9 days 21 hours 53 min 36 sec
CPU time	9 days 11 hours 35 min 41 sec
Validate state	Invalid
Credit	6,145.53
Device peak FLOPS	2.26 GFLOPS
Application version	UK Met Office FAMOUS v6.11 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:27:12 (2152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:27:18 (2152): No heartbeat from core client for 30 sec - exiting 13:59:07 (4760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Model crashed: TEMPHIST: Write ERROR on history file for namelistNLIHISTO tmp/pipe_dummy Model crashed: TEMPHIST: Write ERROR on history file for namelistNLIHISTO tmp/pipe_dummy Model crashed: TEMPHIST: Write ERROR on history file for namelistNLIHISTO tmp/pipe_dummy 11:52:19 (4192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:52:30 (4192): No heartbeat from core client for 30 sec - exiting 11:52:35 (4192): No heartbeat from core client for 30 sec - exiting 11:52:40 (4192): No heartbeat from core client for 30 sec - exiting 11:52:44 (4192): No heartbeat from core client for 30 sec - exiting 19:43:02 (1896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:32:11 (5612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:58:57 (4500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:29:21 (4408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:32:12 (4408): No heartbeat from core client for 30 sec - exiting 03:29:50 (1076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:29:53 (1076): No heartbeat from core client for 30 sec - exiting 03:29:55 (1076): No heartbeat from core client for 30 sec - exiting BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 03:52:06 (3248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:02:29 (5852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:36:46 (6028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:37:06 (6028): No heartbeat from core client for 30 sec - exiting Model crashed: TEMPHIST: Write ERROR on history file for namelistNLIHISTO tmp/pipe_dummy 09:49:41 (5676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:15:45 (2860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:14:06 (4820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:14:22 (4820): No heartbeat from core client for 30 sec - exiting 15:14:36 (4820): No heartbeat from core client for 30 sec - exiting 1forrtl: severe (47): write to READONLY file, unit 6, file C:\ProgramData\BOINC\projects\climateprediction.net\famous_v46q_1899_200_006691192\dataout\stdout_um.txt Image PC Routine Line Source famous_um_6.11_wi 008846D2 Unknown Unknown Unknown Stack trace terminated abnormally. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4380, iMonCtr=1 Model crash detected, will try to restart... forrtl: severe (47): write to READONLY file, unit 6, file C:\ProgramData\BOINC\projects\climateprediction.net\famous_v46q_1899_200_006691192\dataout\stdout_um.txt Image PC Routine Line Source famous_um_6.11_wi 008846D2 Unknown Unknown Unknown Stack trace terminated abnormally. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4380, iMonCtr=1 Model crash detected, will try to restart... forrtl: severe (47): write to READONLY file, unit 6, file C:\ProgramData\BOINC\projects\climateprediction.net\famous_v46q_1899_200_006691192\dataout\stdout_um.txt Image PC Routine Line Source famous_um_6.11_wi 008846D2 Unknown Unknown Unknown Stack trace terminated abnormally. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4380, iMonCtr=1 Model crash detected, will try to restart... forrtl: severe (47): write to READONLY file, unit 6, file C:\ProgramData\BOINC\projects\climateprediction.net\famous_v46q_1899_200_006691192\dataout\stdout_um.txt Image PC Routine Line Source famous_um_6.11_wi 008846D2 Unknown Unknown Unknown Stack trace terminated abnormally. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4380, iMonCtr=1 Model crash detected, will try to restart... 16:09:53 (4380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:09:55 (4380): No heartbeat from core client for 30 sec - exiting 16:09:56 (4380): No heartbeat from core client for 30 sec - exiting BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Model crashed: TEMPHIST: Write ERROR on history file for namelistNLIHISTO tmp/pipe_dummy 16:47:40 (4144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:59:30 (5136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:59:35 (5136): No heartbeat from core client for 30 sec - exiting 16:59:36 (5136): No heartbeat from core client for 30 sec - exiting 17:03:24 (6124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:16:06 (3836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:16:09 (3836): No heartbeat from core client for 30 sec - exiting 17:16:10 (3836): No heartbeat from core client for 30 sec - exiting 17:26:13 (4880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:26:32 (4880): No heartbeat from core client for 30 sec - exiting 17:53:20 (2608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:53:34 (2608): No heartbeat from core client for 30 sec - exiting 19:31:25 (3016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:31:33 (3016): No heartbeat from core client for 30 sec - exiting 19:31:38 (3016): No heartbeat from core client for 30 sec - exiting Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/pipe_dummy Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/pipe_dummy Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/pipe_dummy Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/pipe_dummy Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/pipe_dummy Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/pipe_dummy Sorry, too many model crashes! :-( 19:33:01 (5732): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
22 Oct 2010 17:12:39	1093122	11881720	famous_v46q_1899_200_006691192_6	1,862,666	815,505	0.4378
22 Oct 2010 15:07:37	1093122	11881720	famous_v46q_1899_200_006691192_6	1,853,306	811,500	0.4379
22 Oct 2010 13:41:18	1093122	11881720	famous_v46q_1899_200_006691192_6	1,843,946	807,504	0.4379
22 Oct 2010 12:19:17	1093122	11881720	famous_v46q_1899_200_006691192_6	1,834,586	803,509	0.4380
22 Oct 2010 11:03:00	1093122	11881720	famous_v46q_1899_200_006691192_6	1,825,226	799,520	0.4380
22 Oct 2010 09:41:45	1093122	11881720	famous_v46q_1899_200_006691192_6	1,815,866	795,529	0.4381
22 Oct 2010 08:10:09	1093122	11881720	famous_v46q_1899_200_006691192_6	1,806,506	791,534	0.4382
22 Oct 2010 06:57:47	1093122	11881720	famous_v46q_1899_200_006691192_6	1,797,146	787,564	0.4382
22 Oct 2010 05:34:42	1093122	11881720	famous_v46q_1899_200_006691192_6	1,787,786	783,574	0.4383
22 Oct 2010 04:15:06	1093122	11881720	famous_v46q_1899_200_006691192_6	1,778,426	779,580	0.4384
22 Oct 2010 04:15:06	1093122	11881720	famous_v46q_1899_200_006691192_6	1,769,066	775,563	0.4384
22 Oct 2010 04:15:06	1093122	11881720	famous_v46q_1899_200_006691192_6	1,759,706	771,585	0.4385
21 Oct 2010 23:35:37	1093122	11881720	famous_v46q_1899_200_006691192_6	1,750,346	767,563	0.4385
21 Oct 2010 22:13:53	1093122	11881720	famous_v46q_1899_200_006691192_6	1,740,986	763,576	0.4386
21 Oct 2010 20:53:33	1093122	11881720	famous_v46q_1899_200_006691192_6	1,731,626	759,567	0.4386
21 Oct 2010 19:32:28	1093122	11881720	famous_v46q_1899_200_006691192_6	1,722,266	755,598	0.4387
21 Oct 2010 18:11:05	1093122	11881720	famous_v46q_1899_200_006691192_6	1,712,906	751,571	0.4388
21 Oct 2010 16:49:50	1093122	11881720	famous_v46q_1899_200_006691192_6	1,703,546	747,598	0.4388
21 Oct 2010 15:33:33	1093122	11881720	famous_v46q_1899_200_006691192_6	1,694,186	743,627	0.4389
21 Oct 2010 14:16:59	1093122	11881720	famous_v46q_1899_200_006691192_6	1,684,826	739,633	0.4390