Task 11554207

Name	famous_ulgz_1599_200_006660670_4
Workunit	6864042
Created	10 Jun 2010, 15:03:38 UTC
Sent	11 Jul 2010, 1:23:06 UTC
Report deadline	10 Oct 2010, 8:50:17 UTC
Received	26 Jul 2010, 1:04:26 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1076001
Run time	7 days 23 hours 37 min 40 sec
CPU time	7 days 15 hours 38 min 55 sec
Validate state	Invalid
Credit	1,667.69
Device peak FLOPS	1.29 GFLOPS
Application version	UK Met Office FAMOUS v6.11 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3992, selfPID=3992, iMonCtr=1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3916, selfPID=3916, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:25:41 (5024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5464, selfPID=5464, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5284, selfPID=5284, iMonCtr=1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=948, selfPID=948, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4944, selfPID=4944, iMonCtr=1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3932, selfPID=3932, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... OPEN: File Creation Failed: Not enough space OPEN: Unable to Open File dataout/ulgzla#da0000016542g+ for Read/Write Model crashed: DUMPCTL : Fail to open output dump - may already exist tmp/pipe_dummy Model crashed: tmp/pipe_dummy OPEN: File Open Failed: No such file or directory OPEN: Unable to Open File dataout/atmos_restart.day for Reading Model crashed: DRLANDF1 : Error in FILE_OPEN. tmp/pipe_dummy forrtl: Not enough quota is available to process this command. forrtl: severe (30): Message not found Stack trace terminated abnormally. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3124, iMonCtr=1 Model crash detected, will try to restart... forrtl: FormatMessage failed for sysmem message number 1816forrtl: severe (38): Message not found Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3124, iMonCtr=1 Model crash detected, will try to restart... 08:50:44 (2812): start_timer_thread(): CreateThread() failed, errno 0 *************************************** ************************************* Model completed with the following : Error Code : 500 Message : ************************************* *************************************** Model crashed: dataout/stdout_um.txt Sorry, too many model crashes! :-( 08:50:45 (3124): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Jul 2010 12:09:04	1076001	11554207	famous_ulgz_1599_200_006660670_4	505,466	658,648	1.3031
25 Jul 2010 05:37:13	1076001	11554207	famous_ulgz_1599_200_006660670_4	496,106	646,464	1.3031
24 Jul 2010 21:26:58	1076001	11554207	famous_ulgz_1599_200_006660670_4	486,746	634,250	1.3030
24 Jul 2010 14:51:51	1076001	11554207	famous_ulgz_1599_200_006660670_4	477,386	622,083	1.3031
24 Jul 2010 07:19:23	1076001	11554207	famous_ulgz_1599_200_006660670_4	468,026	609,878	1.3031
23 Jul 2010 23:56:14	1076001	11554207	famous_ulgz_1599_200_006660670_4	458,666	597,688	1.3031
23 Jul 2010 16:00:51	1076001	11554207	famous_ulgz_1599_200_006660670_4	449,306	585,531	1.3032
23 Jul 2010 12:28:28	1076001	11554207	famous_ulgz_1599_200_006660670_4	439,946	573,401	1.3033
23 Jul 2010 07:19:29	1076001	11554207	famous_ulgz_1599_200_006660670_4	430,586	561,222	1.3034
23 Jul 2010 01:54:19	1076001	11554207	famous_ulgz_1599_200_006660670_4	421,226	549,141	1.3037
22 Jul 2010 16:05:51	1076001	11554207	famous_ulgz_1599_200_006660670_4	411,866	536,961	1.3037
22 Jul 2010 11:31:33	1076001	11554207	famous_ulgz_1599_200_006660670_4	402,506	524,790	1.3038
22 Jul 2010 03:00:39	1076001	11554207	famous_ulgz_1599_200_006660670_4	393,146	512,648	1.3040
21 Jul 2010 19:07:37	1076001	11554207	famous_ulgz_1599_200_006660670_4	383,786	500,560	1.3043
21 Jul 2010 14:39:03	1076001	11554207	famous_ulgz_1599_200_006660670_4	374,426	488,445	1.3045
21 Jul 2010 05:56:24	1076001	11554207	famous_ulgz_1599_200_006660670_4	365,066	476,303	1.3047
21 Jul 2010 00:28:16	1076001	11554207	famous_ulgz_1599_200_006660670_4	355,706	464,089	1.3047
20 Jul 2010 15:54:32	1076001	11554207	famous_ulgz_1599_200_006660670_4	346,346	451,788	1.3044
20 Jul 2010 08:27:13	1076001	11554207	famous_ulgz_1599_200_006660670_4	336,986	439,454	1.3041
20 Jul 2010 01:52:02	1076001	11554207	famous_ulgz_1599_200_006660670_4	327,626	427,103	1.3036