Task 11526549

Name	famous_uh7e_1999_200_006655141_3
Workunit	6858513
Created	10 Jun 2010, 14:14:57 UTC
Sent	24 Aug 2010, 11:03:29 UTC
Report deadline	23 Nov 2010, 18:30:40 UTC
Received	16 Sep 2010, 15:01:28 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1095977
Run time	16 days 0 hours 27 min 15 sec
CPU time	15 days 11 hours 56 min 34 sec
Validate state	Invalid
Credit	5,280.85
Device peak FLOPS	1.46 GFLOPS
Application version	UK Met Office FAMOUS v6.11 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1656, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4476, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4712, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 10:12:42 (5196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:12:43 (5196): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5076, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4356, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2972, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2972, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5352, iMonCtr=1 Model crash detected, will try to restart... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3540, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3140, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4516, iMonCtr=1 Model crash detected, will try to restart... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3836, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4344, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4980, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4612, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=444, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5308, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1468, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3968, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5272, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2736, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5372, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5920, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5876, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5376, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file D:\BOINCdata/projects/climateprediction.net/famous_uh7e_1999_200_006655141/dataout/atmos_restart.day after 11 attempts Model crashed: DRLANDF1 : Error in FILE_OPEN. tmp/pipe_dummy cpdnmonitor: cannot open input file D:\BOINCdata/projects/climateprediction.net/famous_uh7e_1999_200_006655141/dataout/atmos_restart.day after 11 attempts Model crashed: DRLANDF1 : Error in FILE_OPEN. tmp/pipe_dummy cpdnmonitor: cannot open input file D:\BOINCdata/projects/climateprediction.net/famous_uh7e_1999_200_006655141/dataout/atmos_restart.day after 11 attempts Model crashed: DRLANDF1 : Error in FILE_OPEN. tmp/pipe_dummy cpdnmonitor: cannot open input file D:\BOINCdata/projects/climateprediction.net/famous_uh7e_1999_200_006655141/dataout/atmos_restart.day after 11 attempts Model crashed: DRLANDF1 : Error in FILE_OPEN. tmp/pipe_dummy cpdnmonitor: cannot open input file D:\BOINCdata/projects/climateprediction.net/famous_uh7e_1999_200_006655141/dataout/atmos_restart.day after 11 attempts Model crashed: DRLANDF1 : Error in FILE_OPEN. tmp/pipe_dummy cpdnmonitor: cannot open input file D:\BOINCdata/projects/climateprediction.net/famous_uh7e_1999_200_006655141/dataout/atmos_restart.day after 11 attempts Model crashed: DRLANDF1 : Error in FILE_OPEN. tmp/pipe_dummy Sorry, too many model crashes! :-( 16:45:52 (6040): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
16 Sep 2010 12:20:17	1095977	11526549	famous_uh7e_1999_200_006655141_3	1,600,586	1,331,312	0.8318
16 Sep 2010 09:53:15	1095977	11526549	famous_uh7e_1999_200_006655141_3	1,591,226	1,323,269	0.8316
16 Sep 2010 07:33:27	1095977	11526549	famous_uh7e_1999_200_006655141_3	1,581,866	1,315,262	0.8315
16 Sep 2010 04:17:56	1095977	11526549	famous_uh7e_1999_200_006655141_3	1,572,506	1,307,260	0.8313
16 Sep 2010 02:01:08	1095977	11526549	famous_uh7e_1999_200_006655141_3	1,563,146	1,299,253	0.8312
15 Sep 2010 23:43:18	1095977	11526549	famous_uh7e_1999_200_006655141_3	1,553,786	1,291,302	0.8311
15 Sep 2010 21:26:04	1095977	11526549	famous_uh7e_1999_200_006655141_3	1,544,426	1,283,341	0.8310
15 Sep 2010 19:06:15	1095977	11526549	famous_uh7e_1999_200_006655141_3	1,535,066	1,275,334	0.8308
15 Sep 2010 13:16:34	1095977	11526549	famous_uh7e_1999_200_006655141_3	1,525,706	1,267,289	0.8306
15 Sep 2010 10:52:45	1095977	11526549	famous_uh7e_1999_200_006655141_3	1,516,346	1,259,271	0.8305
15 Sep 2010 07:37:54	1095977	11526549	famous_uh7e_1999_200_006655141_3	1,506,986	1,251,245	0.8303
15 Sep 2010 05:24:21	1095977	11526549	famous_uh7e_1999_200_006655141_3	1,497,626	1,243,237	0.8301
15 Sep 2010 03:05:18	1095977	11526549	famous_uh7e_1999_200_006655141_3	1,488,266	1,235,230	0.8300
15 Sep 2010 01:49:10	1095977	11526549	famous_uh7e_1999_200_006655141_3	1,478,906	1,227,229	0.8298
14 Sep 2010 22:33:12	1095977	11526549	famous_uh7e_1999_200_006655141_3	1,469,546	1,219,291	0.8297
14 Sep 2010 20:06:23	1095977	11526549	famous_uh7e_1999_200_006655141_3	1,460,186	1,211,281	0.8295
14 Sep 2010 17:44:57	1095977	11526549	famous_uh7e_1999_200_006655141_3	1,450,826	1,203,219	0.8293
14 Sep 2010 15:26:56	1095977	11526549	famous_uh7e_1999_200_006655141_3	1,441,466	1,195,201	0.8292
14 Sep 2010 13:06:50	1095977	11526549	famous_uh7e_1999_200_006655141_3	1,432,106	1,187,206	0.8290
14 Sep 2010 10:53:22	1095977	11526549	famous_uh7e_1999_200_006655141_3	1,422,746	1,179,198	0.8288