Task 11840353

Name	famous_vnds_1599_200_006716070_4
Workunit	6919323
Created	26 Aug 2010, 17:59:34 UTC
Sent	16 Sep 2010, 23:47:32 UTC
Report deadline	17 Dec 2010, 7:14:43 UTC
Received	19 Sep 2010, 2:29:45 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	986959
Run time
CPU time	1 days 6 hours 3 min 44 sec
Validate state	Invalid
Credit	833.89
Device peak FLOPS	2.50 GFLOPS
Application version	UK Met Office FAMOUS v6.11 windows_intelx86
Stderr	<core_client_version>5.8.15</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> 08:28:54 (7544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:46:50 (3488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:19:17 (7952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:26:10 (7216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:26:11 (7216): No heartbeat from core client for 30 sec - exiting 09:26:12 (7216): No heartbeat from core client for 30 sec - exiting 09:26:13 (7216): No heartbeat from core client for 30 sec - exiting 09:26:16 (7216): No heartbeat from core client for 30 sec - exiting CreateProcess failed: 'The system cannot find the path specified. (0x3)' 09:38:01 (4172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:44:02 (5596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:01:07 (2552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:01:11 (2552): No heartbeat from core client for 30 sec - exiting 10:01:12 (2552): No heartbeat from core client for 30 sec - exiting 10:01:13 (2552): No heartbeat from core client for 30 sec - exiting 10:01:15 (2552): No heartbeat from core client for 30 sec - exiting 15:11:14 (4276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:11:16 (4276): No heartbeat from core client for 30 sec - exiting 15:11:17 (4276): No heartbeat from core client for 30 sec - exiting 15:11:18 (4276): No heartbeat from core client for 30 sec - exiting 15:11:20 (4276): No heartbeat from core client for 30 sec - exiting 15:11:21 (4276): No heartbeat from core client for 30 sec - exiting 15:11:22 (4276): No heartbeat from core client for 30 sec - exiting 17:23:24 (5072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:31:00 (1496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:11:48 (4196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:11:56 (4196): No heartbeat from core client for 30 sec - exiting 18:20:13 (4320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:02:37 (5584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:27:00 (2328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:26:51 (3700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:26:56 (3700): No heartbeat from core client for 30 sec - exiting 20:30:51 (5176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:35:25 (2456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:40:17 (1864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:50:28 (6128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:50:30 (6128): No heartbeat from core client for 30 sec - exiting 20:50:31 (6128): No heartbeat from core client for 30 sec - exiting 20:50:32 (6128): No heartbeat from core client for 30 sec - exiting 20:50:33 (6128): No heartbeat from core client for 30 sec - exiting 20:50:34 (6128): No heartbeat from core client for 30 sec - exiting 20:50:35 (6128): No heartbeat from core client for 30 sec - exiting 20:50:36 (6128): No heartbeat from core client for 30 sec - exiting 20:50:37 (6128): No heartbeat from core client for 30 sec - exiting 20:50:38 (6128): No heartbeat from core client for 30 sec - exiting 20:50:39 (6128): No heartbeat from core client for 30 sec - exiting 21:02:33 (628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:28:42 (4244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:28:45 (4244): No heartbeat from core client for 30 sec - exiting 21:38:50 (5100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:48:03 (1076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 21:59:21 (1100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 22:09:03 (5512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4264, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4264, iMonCtr=1 Model crash detected, will try to restart... 22:13:13 (4264): No heartbeat from core client for 30 sec - exiting 22:13:16 (4264): No heartbeat from core client for 30 sec - exiting 22:13:17 (4264): No heartbeat from core client for 30 sec - exiting 22:13:18 (4264): No heartbeat from core client for 30 sec - exiting 22:13:20 (4264): No heartbeat from core client for 30 sec - exiting 22:13:21 (4264): No heartbeat from core client for 30 sec - exiting 22:13:22 (4264): No heartbeat from core client for 30 sec - exiting 22:13:23 (4264): No heartbeat from core client for 30 sec - exiting 22:13:24 (4264): No heartbeat from core client for 30 sec - exiting 22:13:25 (4264): No heartbeat from core client for 30 sec - exiting 22:13:26 (4264): No heartbeat from core client for 30 sec - exiting 22:13:28 (4264): No heartbeat from core client for 30 sec - exiting 22:13:29 (4264): No heartbeat from core client for 30 sec - exiting 22:13:30 (4264): No heartbeat from core client for 30 sec - exiting 22:13:31 (4264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:47:02 (4976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:44:28 (4796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:44:30 (4796): No heartbeat from core client for 30 sec - exiting 07:48:36 (7844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:27:33 (7796): No heartbeat from core client for 30 sec - exiting 08:27:40 (7796): No heartbeat from core client for 30 sec - exiting 08:27:41 (7796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 08:39:00 (1688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:48:55 (4896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:48:59 (4896): No heartbeat from core client for 30 sec - exiting 09:13:47 (8128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:29:05 (3364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:46:24 (4544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:58:55 (7380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:59:24 (7380): No heartbeat from core client for 30 sec - exiting 09:59:25 (7380): No heartbeat from core client for 30 sec - exiting cpdnmonitor: cannot open input file C:\Program Files\BOINC/projects/climateprediction.net/famous_vnds_1599_200_006716070/dataout/atmos_restart.day after 11 attempts Model crashed: DRLANDF1 : Error in FILE_OPEN. tmp/pipe_dummy cpdnmonitor: cannot open input file C:\Program Files\BOINC/projects/climateprediction.net/famous_vnds_1599_200_006716070/dataout/atmos_restart.day after 11 attempts Model crashed: DRLANDF1 : Error in FILE_OPEN. tmp/pipe_dummy cpdnmonitor: cannot open input file C:\Program Files\BOINC/projects/climateprediction.net/famous_vnds_1599_200_006716070/dataout/atmos_restart.day after 11 attempts Model crashed: DRLANDF1 : Error in FILE_OPEN. tmp/pipe_dummy cpdnmonitor: cannot open input file C:\Program Files\BOINC/projects/climateprediction.net/famous_vnds_1599_200_006716070/dataout/atmos_restart.day after 11 attempts Model crashed: DRLANDF1 : Error in FILE_OPEN. tmp/pipe_dummy cpdnmonitor: cannot open input file C:\Program Files\BOINC/projects/climateprediction.net/famous_vnds_1599_200_006716070/dataout/atmos_restart.day after 11 attempts Model crashed: DRLANDF1 : Error in FILE_OPEN. tmp/pipe_dummy cpdnmonitor: cannot open input file C:\Program Files\BOINC/projects/climateprediction.net/famous_vnds_1599_200_006716070/dataout/atmos_restart.day after 11 attempts Model crashed: DRLANDF1 : Error in FILE_OPEN. tmp/pipe_dummy Sorry, too many model crashes! :-( 10:08:55 (8044): called boinc_finish 10:08:55 (8044): No heartbeat from core client for 30 sec - exiting </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
19 Sep 2010 02:33:28	986959	11840353	famous_vnds_1599_200_006716070_4	252,746	107,147	0.4239
18 Sep 2010 21:31:17	986959	11840353	famous_vnds_1599_200_006716070_4	243,386	103,140	0.4238
18 Sep 2010 19:00:22	986959	11840353	famous_vnds_1599_200_006716070_4	234,026	98,870	0.4225
18 Sep 2010 17:12:32	986959	11840353	famous_vnds_1599_200_006716070_4	224,666	94,633	0.4212
18 Sep 2010 15:52:53	986959	11840353	famous_vnds_1599_200_006716070_4	215,306	90,679	0.4212
18 Sep 2010 13:52:05	986959	11840353	famous_vnds_1599_200_006716070_4	205,946	86,960	0.4222
18 Sep 2010 10:17:58	986959	11840353	famous_vnds_1599_200_006716070_4	196,586	83,016	0.4223
18 Sep 2010 07:45:15	986959	11840353	famous_vnds_1599_200_006716070_4	187,226	79,036	0.4221
18 Sep 2010 05:28:27	986959	11840353	famous_vnds_1599_200_006716070_4	177,866	75,278	0.4232
18 Sep 2010 03:26:13	986959	11840353	famous_vnds_1599_200_006716070_4	168,506	71,299	0.4231
18 Sep 2010 02:27:03	986959	11840353	famous_vnds_1599_200_006716070_4	159,146	67,304	0.4229
18 Sep 2010 02:27:03	986959	11840353	famous_vnds_1599_200_006716070_4	149,786	63,347	0.4229
17 Sep 2010 23:06:59	986959	11840353	famous_vnds_1599_200_006716070_4	140,426	59,381	0.4229
17 Sep 2010 21:42:50	986959	11840353	famous_vnds_1599_200_006716070_4	131,066	55,394	0.4226
17 Sep 2010 20:22:54	986959	11840353	famous_vnds_1599_200_006716070_4	121,706	51,418	0.4225
17 Sep 2010 18:58:02	986959	11840353	famous_vnds_1599_200_006716070_4	112,346	47,421	0.4221
17 Sep 2010 17:38:53	986959	11840353	famous_vnds_1599_200_006716070_4	102,986	43,431	0.4217
17 Sep 2010 16:13:18	986959	11840353	famous_vnds_1599_200_006716070_4	93,626	39,411	0.4209
17 Sep 2010 14:47:49	986959	11840353	famous_vnds_1599_200_006716070_4	84,266	35,377	0.4198
17 Sep 2010 13:28:37	986959	11840353	famous_vnds_1599_200_006716070_4	74,906	31,372	0.4188