Task 11571226

Name	famous_uo3i_1799_200_006664073_2
Workunit	6867445
Created	10 Jun 2010, 15:33:44 UTC
Sent	2 Jul 2010, 23:01:34 UTC
Report deadline	2 Oct 2010, 6:28:45 UTC
Received	3 Jul 2010, 23:38:36 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1134514
Run time	4 hours 34 min 38 sec
CPU time	2 hours 34 min 19 sec
Validate state	Invalid
Credit	61.85
Device peak FLOPS	2.67 GFLOPS
Application version	UK Met Office FAMOUS v6.11 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> 17:17:49 (1260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:19:34 (4284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:20:45 (2632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:26:05 (3500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:26:06 (3500): No heartbeat from core client for 30 sec - exiting 17:26:08 (3500): No heartbeat from core client for 30 sec - exiting 17:27:28 (1060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:28:59 (1300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:31:44 (3516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:33:00 (2848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:36:57 (2544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:44:42 (3576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:45:55 (3524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:46:36 (2560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:47:45 (2924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:50:29 (3240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:53:30 (4100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:53:31 (4100): No heartbeat from core client for 30 sec - exiting 17:53:32 (4100): No heartbeat from core client for 30 sec - exiting 17:53:33 (4100): No heartbeat from core client for 30 sec - exiting 17:53:34 (4100): No heartbeat from core client for 30 sec - exiting 17:53:35 (4100): No heartbeat from core client for 30 sec - exiting 17:53:36 (4100): No heartbeat from core client for 30 sec - exiting 17:53:37 (4100): No heartbeat from core client for 30 sec - exiting 17:53:38 (4100): No heartbeat from core client for 30 sec - exiting 17:53:40 (4100): No heartbeat from core client for 30 sec - exiting 17:53:41 (4100): No heartbeat from core client for 30 sec - exiting 17:55:13 (4368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:56:48 (4596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:58:38 (4480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:00:56 (4428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:04:50 (4336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:05:49 (4552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:07:33 (3224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:07:34 (3224): No heartbeat from core client for 30 sec - exiting 18:07:35 (3224): No heartbeat from core client for 30 sec - exiting 18:07:36 (3224): No heartbeat from core client for 30 sec - exiting 18:07:37 (3224): No heartbeat from core client for 30 sec - exiting 18:07:39 (3224): No heartbeat from core client for 30 sec - exiting 18:07:40 (3224): No heartbeat from core client for 30 sec - exiting 18:07:41 (3224): No heartbeat from core client for 30 sec - exiting 18:07:42 (3224): No heartbeat from core client for 30 sec - exiting 18:07:43 (3224): No heartbeat from core client for 30 sec - exiting 18:07:44 (3224): No heartbeat from core client for 30 sec - exiting 18:08:29 (2992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:13:34 (4268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:15:18 (4756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:18:32 (2980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:18:34 (2980): No heartbeat from core client for 30 sec - exiting 18:18:35 (2980): No heartbeat from core client for 30 sec - exiting 18:18:36 (2980): No heartbeat from core client for 30 sec - exiting 18:18:37 (2980): No heartbeat from core client for 30 sec - exiting 18:18:38 (2980): No heartbeat from core client for 30 sec - exiting 18:18:39 (2980): No heartbeat from core client for 30 sec - exiting 18:18:40 (2980): No heartbeat from core client for 30 sec - exiting 18:18:41 (2980): No heartbeat from core client for 30 sec - exiting 18:18:42 (2980): No heartbeat from core client for 30 sec - exiting 18:18:43 (2980): No heartbeat from core client for 30 sec - exiting 18:20:05 (4464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:23:37 (2588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:26:30 (4932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:27:52 (4920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:35:43 (2544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:38:26 (2476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:41:03 (4124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:41:43 (1996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:42:51 (3720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:45:40 (3884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:47:54 (940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:48:53 (3084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:48:54 (3084): No heartbeat from core client for 30 sec - exiting 18:48:55 (3084): No heartbeat from core client for 30 sec - exiting 18:48:56 (3084): No heartbeat from core client for 30 sec - exiting 18:48:58 (3084): No heartbeat from core client for 30 sec - exiting 18:48:59 (3084): No heartbeat from core client for 30 sec - exiting 18:49:00 (3084): No heartbeat from core client for 30 sec - exiting 18:49:01 (3084): No heartbeat from core client for 30 sec - exiting 18:49:02 (3084): No heartbeat from core client for 30 sec - exiting 18:49:03 (3084): No heartbeat from core client for 30 sec - exiting 18:49:04 (3084): No heartbeat from core client for 30 sec - exiting 18:50:24 (4656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:51:59 (4872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:54:21 (1164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:01:27 (2592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:02:27 (4820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:05:16 (3576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:06:37 (4528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:08:59 (4196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:09:49 (4452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:12:41 (1872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:15:21 (4524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:20:13 (4384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:20:14 (4384): No heartbeat from core client for 30 sec - exiting 19:20:15 (4384): No heartbeat from core client for 30 sec - exiting 19:20:16 (4384): No heartbeat from core client for 30 sec - exiting 19:20:17 (4384): No heartbeat from core client for 30 sec - exiting 19:20:18 (4384): No heartbeat from core client for 30 sec - exiting 19:20:19 (4384): No heartbeat from core client for 30 sec - exiting 19:20:21 (4384): No heartbeat from core client for 30 sec - exiting 19:20:22 (4384): No heartbeat from core client for 30 sec - exiting 19:20:23 (4384): No heartbeat from core client for 30 sec - exiting 19:20:24 (4384): No heartbeat from core client for 30 sec - exiting 19:22:30 (3724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:23:47 (1872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:26:12 (3184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:27:52 (4936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:29:36 (4296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:30:19 (3188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:31:24 (1800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:32:32 (4540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:32:33 (4540): No heartbeat from core client for 30 sec - exiting 19:32:34 (4540): No heartbeat from core client for 30 sec - exiting 19:32:35 (4540): No heartbeat from core client for 30 sec - exiting 19:32:37 (4540): No heartbeat from core client for 30 sec - exiting 19:32:38 (4540): No heartbeat from core client for 30 sec - exiting 19:32:39 (4540): No heartbeat from core client for 30 sec - exiting 19:32:40 (4540): No heartbeat from core client for 30 sec - exiting 19:32:41 (4540): No heartbeat from core client for 30 sec - exiting 19:32:42 (4540): No heartbeat from core client for 30 sec - exiting 19:32:43 (4540): No heartbeat from core client for 30 sec - exiting 19:33:40 (4548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:33:41 (4548): No heartbeat from core client for 30 sec - exiting 19:33:42 (4548): No heartbeat from core client for 30 sec - exiting 19:33:43 (4548): No heartbeat from core client for 30 sec - exiting 19:33:44 (4548): No heartbeat from core client for 30 sec - exiting 19:33:45 (4548): No heartbeat from core client for 30 sec - exiting 19:33:47 (4548): No heartbeat from core client for 30 sec - exiting 19:33:48 (4548): No heartbeat from core client for 30 sec - exiting 19:33:49 (4548): No heartbeat from core client for 30 sec - exiting 19:33:50 (4548): No heartbeat from core client for 30 sec - exiting 19:33:51 (4548): No heartbeat from core client for 30 sec - exiting 19:37:08 (4212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:38:47 (4952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:41:56 (4808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:44:10 (4792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:49:37 (4992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:52:31 (1124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:55:34 (4232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:57:49 (4268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:59:13 (1900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:01:36 (3204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:03:51 (4560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:16:09 (1480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:16:53 (4156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:16:54 (4156): No heartbeat from core client for 30 sec - exiting 20:16:55 (4156): No heartbeat from core client for 30 sec - exiting 20:16:56 (4156): No heartbeat from core client for 30 sec - exiting 20:16:57 (4156): No heartbeat from core client for 30 sec - exiting 20:16:58 (4156): No heartbeat from core client for 30 sec - exiting 20:16:59 (4156): No heartbeat from core client for 30 sec - exiting 20:17:00 (4156): No heartbeat from core client for 30 sec - exiting 20:17:01 (4156): No heartbeat from core client for 30 sec - exiting 20:17:02 (4156): No heartbeat from core client for 30 sec - exiting 20:17:04 (4156): No heartbeat from core client for 30 sec - exiting 20:19:40 (1108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:24:10 (4364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:26:26 (4748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:46:24 (3140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:36:59 (2872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:01:43 (2184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:32:31 (4760): No heartbeat from core client for 30 sec - exiting 22:33:32 (4760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... 22:57:40 (4712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:58:56 (4304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:03:27 (2488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:06:13 (3408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:21:41 (3336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:21:42 (3336): No heartbeat from core client for 30 sec - exiting 23:21:43 (3336): No heartbeat from core client for 30 sec - exiting 23:21:44 (3336): No heartbeat from core client for 30 sec - exiting 23:21:45 (3336): No heartbeat from core client for 30 sec - exiting 23:21:46 (3336): No heartbeat from core client for 30 sec - exiting cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/famous_uo3i_1799_200_006664073/dataout/atmos_restart.day after 11 attempts Model crashed: DRLANDF1 : Error in FILE_OPEN. tmp/pipe_dummy cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/famous_uo3i_1799_200_006664073/dataout/atmos_restart.day after 11 attempts Model crashed: DRLANDF1 : Error in FILE_OPEN. tmp/pipe_dummy cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/famous_uo3i_1799_200_006664073/dataout/atmos_restart.day after 11 attempts Model crashed: DRLANDF1 : Error in FILE_OPEN. tmp/pipe_dummy cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/famous_uo3i_1799_200_006664073/dataout/atmos_restart.day after 11 attempts Model crashed: DRLANDF1 : Error in FILE_OPEN. tmp/pipe_dummy cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/famous_uo3i_1799_200_006664073/dataout/atmos_restart.day after 11 attempts Model crashed: DRLANDF1 : Error in FILE_OPEN. tmp/pipe_dummy cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/famous_uo3i_1799_200_006664073/dataout/atmos_restart.day after 11 attempts Model crashed: DRLANDF1 : Error in FILE_OPEN. tmp/pipe_dummy Sorry, too many model crashes! :-( 23:22:57 (4740): called boinc_finish 23:22:57 (4740): No heartbeat from core client for 30 sec - exiting </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
03 Jul 2010 23:40:57	1048971	11571226	famous_uo3i_1799_200_006664073_2	18,746	7,256	0.3871
03 Jul 2010 23:40:57	1048971	11571226	famous_uo3i_1799_200_006664073_2	9,386	4,170	0.4443