Task 11588473

Name	famous_r163_799_200_006666580_1
Workunit	6869952
Created	22 Jun 2010, 10:50:07 UTC
Sent	27 Jun 2010, 20:24:08 UTC
Report deadline	27 Sep 2010, 3:51:19 UTC
Received	4 Jul 2010, 3:00:21 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1077167
Run time	4 days 3 hours 35 min 28 sec
CPU time	3 days 17 hours 49 min 4 sec
Validate state	Invalid
Credit	2,254.45
Device peak FLOPS	2.79 GFLOPS
Application version	UK Met Office FAMOUS v6.11 windows_intelx86
Stderr	<core_client_version>6.10.56</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1300, selfPID=1300, iMonCtr=1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 10:47:08 (2464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:35:16 (1316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 14:30:57 (1320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:12:47 (5844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:01:39 (2208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:31:16 (4732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 01:39:12 (2360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:21:51 (5452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 04:15:14 (5740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:05:26 (3756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:55:26 (3588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:28:50 (5232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:59:18 (4472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:53:20 (5792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 08:50:53 (1064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:00:19 (6076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:24:27 (5852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:47:24 (1004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:56:13 (2692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:13:04 (2512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:35:04 (360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:42:03 (6136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:42:04 (6136): No heartbeat from core client for 30 sec - exiting 10:42:06 (6136): No heartbeat from core client for 30 sec - exiting 10:42:07 (6136): No heartbeat from core client for 30 sec - exiting 10:42:08 (6136): No heartbeat from core client for 30 sec - exiting 10:49:06 (5292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:16:29 (5768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:34:06 (2704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 15:21:21 (1160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:35:07 (3360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:26:13 (3976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:50:39 (4832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:09:53 (1832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:38:36 (3568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:43:45 (3992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:24:16 (5372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:14:15 (5220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:31:23 (5108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:54:20 (4852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2056, selfPID=2056, iMonCtr=1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 09:54:53 (2908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:45:58 (5236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:48:18 (5244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:50:05 (6652): No heartbeat from core client for 30 sec - exiting 16:50:06 (6652): No heartbeat from core client for 30 sec - exiting 16:50:07 (6652): No heartbeat from core client for 30 sec - exiting 16:50:08 (6652): No heartbeat from core client for 30 sec - exiting 16:50:09 (6652): No heartbeat from core client for 30 sec - exiting 16:50:10 (6652): No heartbeat from core client for 30 sec - exiting 16:50:11 (6652): No heartbeat from core client for 30 sec - exiting 16:50:12 (6652): No heartbeat from core client for 30 sec - exiting 16:50:13 (6652): No heartbeat from core client for 30 sec - exiting 16:50:14 (6652): No heartbeat from core client for 30 sec - exiting 16:50:15 (6652): No heartbeat from core client for 30 sec - exiting 16:50:16 (6652): No heartbeat from core client for 30 sec - exiting 16:50:17 (6652): No heartbeat from core client for 30 sec - exiting 16:50:18 (6652): No heartbeat from core client for 30 sec - exiting 16:50:19 (6652): No heartbeat from core client for 30 sec - exiting 16:50:20 (6652): No heartbeat from core client for 30 sec - exiting 16:50:21 (6652): No heartbeat from core client for 30 sec - exiting 16:50:22 (6652): No heartbeat from core client for 30 sec - exiting 16:50:23 (6652): No heartbeat from core client for 30 sec - exiting 16:50:24 (6652): No heartbeat from core client for 30 sec - exiting 16:50:25 (6652): No heartbeat from core client for 30 sec - exiting 16:50:26 (6652): No heartbeat from core client for 30 sec - exiting 16:50:27 (6652): No heartbeat from core client for 30 sec - exiting 16:50:28 (6652): No heartbeat from core client for 30 sec - exiting 16:50:29 (6652): No heartbeat from core client for 30 sec - exiting 16:50:30 (6652): No heartbeat from core client for 30 sec - exiting 16:50:31 (6652): No heartbeat from core client for 30 sec - exiting 16:50:32 (6652): No heartbeat from core client for 30 sec - exiting 16:50:33 (6652): No heartbeat from core client for 30 sec - exiting 16:50:34 (6652): No heartbeat from core client for 30 sec - exiting 16:50:35 (6652): No heartbeat from core client for 30 sec - exiting 16:50:36 (6652): No heartbeat from core client for 30 sec - exiting 16:50:37 (6652): No heartbeat from core client for 30 sec - exiting 16:50:38 (6652): No heartbeat from core client for 30 sec - exiting 16:50:39 (6652): No heartbeat from core client for 30 sec - exiting 16:50:40 (6652): No heartbeat from core client for 30 sec - exiting 16:50:41 (6652): No heartbeat from core client for 30 sec - exiting 16:50:42 (6652): No heartbeat from core client for 30 sec - exiting 16:50:43 (6652): No heartbeat from core client for 30 sec - exiting 16:50:44 (6652): No heartbeat from core client for 30 sec - exiting 16:50:45 (6652): No heartbeat from core client for 30 sec - exiting 16:50:46 (6652): No heartbeat from core client for 30 sec - exiting 16:50:47 (6652): No heartbeat from core client for 30 sec - exiting 16:50:48 (6652): No heartbeat from core client for 30 sec - exiting 16:50:49 (6652): No heartbeat from core client for 30 sec - exiting 16:50:50 (6652): No heartbeat from core client for 30 sec - exiting 16:50:51 (6652): No heartbeat from core client for 30 sec - exiting 16:50:52 (6652): No heartbeat from core client for 30 sec - exiting 16:50:53 (6652): No heartbeat from core client for 30 sec - exiting 16:50:54 (6652): No heartbeat from core client for 30 sec - exiting 16:50:55 (6652): No heartbeat from core client for 30 sec - exiting 16:50:56 (6652): No heartbeat from core client for 30 sec - exiting 16:50:57 (6652): No heartbeat from core client for 30 sec - exiting 16:50:58 (6652): No heartbeat from core client for 30 sec - exiting 16:50:59 (6652): No heartbeat from core client for 30 sec - exiting 16:51:00 (6652): No heartbeat from core client for 30 sec - exiting 16:51:01 (6652): No heartbeat from core client for 30 sec - exiting 16:51:02 (6652): No heartbeat from core client for 30 sec - exiting 16:51:03 (6652): No heartbeat from core client for 30 sec - exiting 16:51:04 (6652): No heartbeat from core client for 30 sec - exiting 16:51:05 (6652): No heartbeat from core client for 30 sec - exiting 16:51:06 (6652): No heartbeat from core client for 30 sec - exiting 16:51:07 (6652): No heartbeat from core client for 30 sec - exiting 16:51:08 (6652): No heartbeat from core client for 30 sec - exiting 16:51:09 (6652): No heartbeat from core client for 30 sec - exiting 16:51:10 (6652): No heartbeat from core client for 30 sec - exiting 16:51:11 (6652): No heartbeat from core client for 30 sec - exiting 16:51:12 (6652): No heartbeat from core client for 30 sec - exiting 16:51:13 (6652): No heartbeat from core client for 30 sec - exiting 16:51:14 (6652): No heartbeat from core client for 30 sec - exiting 16:51:15 (6652): No heartbeat from core client for 30 sec - exiting 16:51:16 (6652): No heartbeat from core client for 30 sec - exiting 16:51:17 (6652): No heartbeat from core client for 30 sec - exiting 16:51:18 (6652): No heartbeat from core client for 30 sec - exiting 16:51:19 (6652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file D:\ProgramData\BOINC/projects/climateprediction.net/famous_r163_799_200_006666580/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy cpdnmonitor: cannot open input file D:\ProgramData\BOINC/projects/climateprediction.net/famous_r163_799_200_006666580/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy cpdnmonitor: cannot open input file D:\ProgramData\BOINC/projects/climateprediction.net/famous_r163_799_200_006666580/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy cpdnmonitor: cannot open input file D:\ProgramData\BOINC/projects/climateprediction.net/famous_r163_799_200_006666580/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy cpdnmonitor: cannot open input file D:\ProgramData\BOINC/projects/climateprediction.net/famous_r163_799_200_006666580/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy cpdnmonitor: cannot open input file D:\ProgramData\BOINC/projects/climateprediction.net/famous_r163_799_200_006666580/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy Sorry, too many model crashes! :-( 22:11:20 (6764): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
04 Jul 2010 01:43:40	1077167	11588473	famous_r163_799_200_006666580_1	683,306	319,991	0.4683
03 Jul 2010 23:59:39	1077167	11588473	famous_r163_799_200_006666580_1	673,946	315,645	0.4684
03 Jul 2010 22:18:15	1077167	11588473	famous_r163_799_200_006666580_1	664,586	311,072	0.4681
03 Jul 2010 20:56:43	1077167	11588473	famous_r163_799_200_006666580_1	655,226	306,929	0.4684
03 Jul 2010 18:28:35	1077167	11588473	famous_r163_799_200_006666580_1	645,866	303,126	0.4693
03 Jul 2010 16:42:48	1077167	11588473	famous_r163_799_200_006666580_1	636,506	297,962	0.4681
03 Jul 2010 15:14:20	1077167	11588473	famous_r163_799_200_006666580_1	627,146	293,640	0.4682
03 Jul 2010 13:41:25	1077167	11588473	famous_r163_799_200_006666580_1	617,786	289,220	0.4682
03 Jul 2010 02:16:11	1077167	11588473	famous_r163_799_200_006666580_1	608,426	284,796	0.4681
03 Jul 2010 01:05:19	1077167	11588473	famous_r163_799_200_006666580_1	599,066	280,493	0.4682
02 Jul 2010 23:47:09	1077167	11588473	famous_r163_799_200_006666580_1	589,706	276,354	0.4686
02 Jul 2010 20:44:52	1077167	11588473	famous_r163_799_200_006666580_1	580,346	271,666	0.4681
02 Jul 2010 19:28:05	1077167	11588473	famous_r163_799_200_006666580_1	570,986	267,444	0.4684
02 Jul 2010 18:00:39	1077167	11588473	famous_r163_799_200_006666580_1	561,626	262,751	0.4678
02 Jul 2010 16:47:43	1077167	11588473	famous_r163_799_200_006666580_1	552,266	258,652	0.4683
02 Jul 2010 15:18:56	1077167	11588473	famous_r163_799_200_006666580_1	542,906	254,019	0.4679
02 Jul 2010 14:04:28	1077167	11588473	famous_r163_799_200_006666580_1	533,546	249,716	0.4680
02 Jul 2010 12:22:04	1077167	11588473	famous_r163_799_200_006666580_1	524,186	245,086	0.4676
02 Jul 2010 04:50:26	1077167	11588473	famous_r163_799_200_006666580_1	514,826	241,016	0.4682
02 Jul 2010 02:58:30	1077167	11588473	famous_r163_799_200_006666580_1	505,466	236,344	0.4676