Task 11463697

Name	famous_u7ic_1599_200_006642575_3
Workunit	6845947
Created	10 Jun 2010, 12:25:50 UTC
Sent	2 Aug 2010, 9:40:48 UTC
Report deadline	1 Nov 2010, 17:07:59 UTC
Received	1 Sep 2010, 13:04:38 UTC
Server state	Over
Outcome	Computation error
Client state	Done
Exit status	22 (0x00000016) Unknown error code
Computer ID	1019344
Run time
CPU time	3 days 5 hours 39 min 25 sec
Validate state	Invalid
Credit	1,945.63
Device peak FLOPS	2.27 GFLOPS
Application version	UK Met Office FAMOUS v6.11 windows_intelx86
Stderr	<core_client_version>5.10.45</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1732, selfPID=1732, iMonCtr=1 Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 14:17:28 (3296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:17:29 (3296): No heartbeat from core client for 30 sec - exiting 14:17:30 (3296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... 23:00:02 (4380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:00:03 (4380): No heartbeat from core client for 30 sec - exiting 23:00:04 (4380): No heartbeat from core client for 30 sec - exiting 23:00:05 (4380): No heartbeat from core client for 30 sec - exiting 23:00:06 (4380): No heartbeat from core client for 30 sec - exiting 23:00:07 (4380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:00:17 (1404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2760, selfPID=2760, iMonCtr=1 08:02:45 (1868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:37:39 (5512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5196, selfPID=5196, iMonCtr=1 Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3748, selfPID=3748, iMonCtr=1 CPDN Monitor - Quit request from BOINC... 21:49:00 (1828): No heartbeat from core client for 30 sec - exiting 21:49:01 (1828): No heartbeat from core client for 30 sec - exiting 21:49:02 (1828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:49:03 (1828): No heartbeat from core client for 30 sec - exiting Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1864, selfPID=1864, iMonCtr=1 18:17:55 (1560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:17:56 (1560): No heartbeat from core client for 30 sec - exiting Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5360, selfPID=5360, iMonCtr=1 15:37:15 (1512): No heartbeat from core client for 30 sec - exiting 15:37:17 (1512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CWorker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1832, selfPID=1832, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3764, selfPID=3764, iMonCtr=1 No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1536, selfPID=1536, iMonCtr=1 CPDN Monitor - Quit request from BOINC... 18:12:42 (1944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:12:43 (1944): No heartbeat from core client for 30 sec - exiting 18:12:44 (1944): No heartbeat from core client for 30 sec - exiting 18:12:45 (1944): No heartbeat from core client for 30 sec - exiting 18:12:46 (1944): No heartbeat from core client for 30 sec - exiting 18:12:47 (1944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3184, selfPID=3184, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:14:25 (2880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:14:26 (2880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\Program Files\BOINC/projects/climateprediction.net/famous_u7ic_1599_200_006642575/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy cpdnmonitor: cannot open input file C:\Program Files\BOINC/projects/climateprediction.net/famous_u7ic_1599_200_006642575/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy cpdnmonitor: cannot open input file C:\Program Files\BOINC/projects/climateprediction.net/famous_u7ic_1599_200_006642575/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy cpdnmonitor: cannot open input file C:\Program Files\BOINC/projects/climateprediction.net/famous_u7ic_1599_200_006642575/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy cpdnmonitor: cannot open input file C:\Program Files\BOINC/projects/climateprediction.net/famous_u7ic_1599_200_006642575/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy cpdnmonitor: cannot open input file C:\Program Files\BOINC/projects/climateprediction.net/famous_u7ic_1599_200_006642575/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy Sorry, too many model crashes! :-( 14:04:08 (3672): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
30 Aug 2010 20:04:51	1019344	11463697	famous_u7ic_1599_200_006642575_3	589,706	275,887	0.4678
30 Aug 2010 17:15:18	1019344	11463697	famous_u7ic_1599_200_006642575_3	580,346	271,872	0.4685
30 Aug 2010 10:35:19	1019344	11463697	famous_u7ic_1599_200_006642575_3	570,986	267,164	0.4679
28 Aug 2010 18:30:54	1019344	11463697	famous_u7ic_1599_200_006642575_3	561,626	262,764	0.4679
28 Aug 2010 15:44:46	1019344	11463697	famous_u7ic_1599_200_006642575_3	552,266	258,528	0.4681
28 Aug 2010 13:05:53	1019344	11463697	famous_u7ic_1599_200_006642575_3	542,906	254,282	0.4684
28 Aug 2010 10:25:50	1019344	11463697	famous_u7ic_1599_200_006642575_3	533,546	250,025	0.4686
28 Aug 2010 07:47:45	1019344	11463697	famous_u7ic_1599_200_006642575_3	524,186	245,750	0.4688
27 Aug 2010 22:21:16	1019344	11463697	famous_u7ic_1599_200_006642575_3	514,826	242,275	0.4706
27 Aug 2010 19:51:45	1019344	11463697	famous_u7ic_1599_200_006642575_3	505,466	238,581	0.4720
27 Aug 2010 13:58:55	1019344	11463697	famous_u7ic_1599_200_006642575_3	496,106	233,093	0.4698
27 Aug 2010 11:34:55	1019344	11463697	famous_u7ic_1599_200_006642575_3	486,746	228,884	0.4702
27 Aug 2010 09:05:35	1019344	11463697	famous_u7ic_1599_200_006642575_3	477,386	224,691	0.4707
26 Aug 2010 21:23:45	1019344	11463697	famous_u7ic_1599_200_006642575_3	468,026	220,528	0.4712
25 Aug 2010 09:08:06	1019344	11463697	famous_u7ic_1599_200_006642575_3	458,666	217,438	0.4741
24 Aug 2010 15:45:32	1019344	11463697	famous_u7ic_1599_200_006642575_3	449,306	210,587	0.4687
24 Aug 2010 07:06:05	1019344	11463697	famous_u7ic_1599_200_006642575_3	439,946	208,284	0.4734
23 Aug 2010 14:09:00	1019344	11463697	famous_u7ic_1599_200_006642575_3	430,586	202,096	0.4694
23 Aug 2010 12:17:47	1019344	11463697	famous_u7ic_1599_200_006642575_3	421,226	195,356	0.4638
23 Aug 2010 10:19:51	1019344	11463697	famous_u7ic_1599_200_006642575_3	411,866	191,587	0.4652