Task 11716147

Name	famous_v491_1999_200_006691275_3
Workunit	6894528
Created	26 Aug 2010, 15:56:27 UTC
Sent	7 Sep 2010, 7:12:54 UTC
Report deadline	7 Dec 2010, 14:40:05 UTC
Received	8 Sep 2010, 15:47:25 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1071581
Run time	12 hours 19 min 15 sec
CPU time	12 hours 22 min 42 sec
Validate state	Invalid
Credit	370.67
Device peak FLOPS	2.51 GFLOPS
Application version	UK Met Office FAMOUS v6.11 windows_intelx86
Stderr	<core_client_version>6.10.43</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 11:46:54 (6504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:46:55 (6504): No heartbeat from core client for 30 sec - exiting 11:46:56 (6504): No heartbeat from core client for 30 sec - exiting 11:46:57 (6504): No heartbeat from core client for 30 sec - exiting 11:46:58 (6504): No heartbeat from core client for 30 sec - exiting 11:46:59 (6504): No heartbeat from core client for 30 sec - exiting 11:47:00 (6504): No heartbeat from core client for 30 sec - exiting 11:47:01 (6504): No heartbeat from core client for 30 sec - exiting 11:47:02 (6504): No heartbeat from core client for 30 sec - exiting 11:47:03 (6504): No heartbeat from core client for 30 sec - exiting 11:47:04 (6504): No heartbeat from core client for 30 sec - exiting Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6316, selfPID=6316, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4020, selfPID=4020, iMonCtr=1 12:19:19 (6760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5320, selfPID=5320, iMonCtr=1 12:24:36 (2596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5840, selfPID=5840, iMonCtr=1 12:29:04 (6620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7428, selfPID=7428, iMonCtr=1 12:31:15 (6988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6016, selfPID=6016, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7264, selfPID=7264, iMonCtr=1 12:46:39 (5640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:46:40 (5640): No heartbeat from core client for 30 sec - exiting 12:46:41 (5640): No heartbeat from core client for 30 sec - exiting 12:46:42 (5640): No heartbeat from core client for 30 sec - exiting 12:46:43 (5640): No heartbeat from core client for 30 sec - exiting 12:46:44 (5640): No heartbeat from core client for 30 sec - exiting 12:46:45 (5640): No heartbeat from core client for 30 sec - exiting 12:46:46 (5640): No heartbeat from core client for 30 sec - exiting 12:46:47 (5640): No heartbeat from core client for 30 sec - exiting 12:46:48 (5640): No heartbeat from core client for 30 sec - exiting 12:46:49 (5640): No heartbeat from core client for 30 sec - exiting Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7368, selfPID=7368, iMonCtr=1 12:49:10 (6940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:49:11 (6940): No heartbeat from core client for 30 sec - exiting Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2852, selfPID=2852, iMonCtr=1 13:02:55 (7692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:02:56 (7692): No heartbeat from core client for 30 sec - exiting 13:02:57 (7692): No heartbeat from core client for 30 sec - exiting 13:02:58 (7692): No heartbeat from core client for 30 sec - exiting 13:02:59 (7692): No heartbeat from core client for 30 sec - exiting No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7456, selfPID=7456, iMonCtr=1 13:36:43 (7188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7624, selfPID=7624, iMonCtr=1 13:46:52 (5172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:46:53 (5172): No heartbeat from core client for 30 sec - exiting 13:46:54 (5172): No heartbeat from core client for 30 sec - exiting Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7228, selfPID=7228, iMonCtr=1 13:48:34 (6976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:48:35 (6976): No heartbeat from core client for 30 sec - exiting 13:48:36 (6976): No heartbeat from core client for 30 sec - exiting 13:48:37 (6976): No heartbeat from core client for 30 sec - exiting No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7932, selfPID=7932, iMonCtr=1 13:50:56 (5452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7176, selfPID=7176, iMonCtr=1 13:52:38 (6572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:52:39 (6572): No heartbeat from core client for 30 sec - exiting No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5304, selfPID=5304, iMonCtr=1 13:55:54 (5072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8108, selfPID=8108, iMonCtr=1 13:57:36 (5248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3680, selfPID=3680, iMonCtr=1 14:02:37 (1408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5212, selfPID=5212, iMonCtr=1 14:08:38 (7828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:08:39 (7828): No heartbeat from core client for 30 sec - exiting 14:08:40 (7828): No heartbeat from core client for 30 sec - exiting 14:08:41 (7828): No heartbeat from core client for 30 sec - exiting 14:08:42 (7828): No heartbeat from core client for 30 sec - exiting 14:08:43 (7828): No heartbeat from core client for 30 sec - exiting 14:08:44 (7828): No heartbeat from core client for 30 sec - exiting 14:08:45 (7828): No heartbeat from core client for 30 sec - exiting 14:08:46 (7828): No heartbeat from core client for 30 sec - exiting 14:08:47 (7828): No heartbeat from core client for 30 sec - exiting 14:08:48 (7828): No heartbeat from core client for 30 sec - exiting Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7172, selfPID=7172, iMonCtr=1 14:10:38 (5908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:10:39 (5908): No heartbeat from core client for 30 sec - exiting 14:10:40 (5908): No heartbeat from core client for 30 sec - exiting 14:10:41 (5908): No heartbeat from core client for 30 sec - exiting 14:10:42 (5908): No heartbeat from core client for 30 sec - exiting 14:10:43 (5908): No heartbeat from core client for 30 sec - exiting 14:10:44 (5908): No heartbeat from core client for 30 sec - exiting 14:10:45 (5908): No heartbeat from core client for 30 sec - exiting 14:10:46 (5908): No heartbeat from core client for 30 sec - exiting 14:10:47 (5908): No heartbeat from core client for 30 sec - exiting 14:10:48 (5908): No heartbeat from core client for 30 sec - exiting Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5036, selfPID=5036, iMonCtr=1 14:12:39 (824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3796, selfPID=3796, iMonCtr=1 14:18:51 (4024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6504, selfPID=6504, iMonCtr=1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 14:53:28 (7376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:53:29 (7376): No heartbeat from core client for 30 sec - exiting Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7456, selfPID=7456, iMonCtr=1 15:22:58 (7616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1404, selfPID=1404, iMonCtr=1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 16:23:52 (7200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7780, selfPID=7780, iMonCtr=1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 16:28:13 (7052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:28:14 (7052): No heartbeat from core client for 30 sec - exiting 16:28:15 (7052): No heartbeat from core client for 30 sec - exiting 16:28:16 (7052): No heartbeat from core client for 30 sec - exiting 16:28:17 (7052): No heartbeat from core client for 30 sec - exiting 16:28:18 (7052): No heartbeat from core client for 30 sec - exiting 16:28:19 (7052): No heartbeat from core client for 30 sec - exiting 16:28:20 (7052): No heartbeat from core client for 30 sec - exiting 16:28:21 (7052): No heartbeat from core client for 30 sec - exiting 16:28:22 (7052): No heartbeat from core client for 30 sec - exiting 16:28:23 (7052): No heartbeat from core client for 30 sec - exiting Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2068, selfPID=2068, iMonCtr=1 17:27:09 (6620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=824, selfPID=824, iMonCtr=1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 18:09:00 (7888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:09:01 (7888): No heartbeat from core client for 30 sec - exiting 18:09:02 (7888): No heartbeat from core client for 30 sec - exiting 18:09:03 (7888): No heartbeat from core client for 30 sec - exiting 18:09:04 (7888): No heartbeat from core client for 30 sec - exiting 18:09:05 (7888): No heartbeat from core client for 30 sec - exiting 18:09:06 (7888): No heartbeat from core client for 30 sec - exiting 18:09:07 (7888): No heartbeat from core client for 30 sec - exiting 18:09:08 (7888): No heartbeat from core client for 30 sec - exiting 18:09:09 (7888): No heartbeat from core client for 30 sec - exiting 18:09:10 (7888): No heartbeat from core client for 30 sec - exiting Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1904, selfPID=1904, iMonCtr=1 18:30:43 (2236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5144, selfPID=5144, iMonCtr=1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 19:13:02 (6068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5320, selfPID=5320, iMonCtr=1 19:29:19 (6228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8172, selfPID=8172, iMonCtr=1 19:38:25 (7044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8088, selfPID=8088, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5872, selfPID=5872, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7264, selfPID=7264, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7580, selfPID=7580, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1188, selfPID=1188, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5800, selfPID=5800, iMonCtr=1 21:01:17 (7612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:01:18 (7612): No heartbeat from core client for 30 sec - exiting 21:01:19 (7612): No heartbeat from core client for 30 sec - exiting 21:01:20 (7612): No heartbeat from core client for 30 sec - exiting 21:01:21 (7612): No heartbeat from core client for 30 sec - exiting 21:01:22 (7612): No heartbeat from core client for 30 sec - exiting 21:01:23 (7612): No heartbeat from core client for 30 sec - exiting 21:01:24 (7612): No heartbeat from core client for 30 sec - exiting 21:01:25 (7612): No heartbeat from core client for 30 sec - exiting 21:01:26 (7612): No heartbeat from core client for 30 sec - exiting 21:01:27 (7612): No heartbeat from core client for 30 sec - exiting Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6196, selfPID=6196, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5880, selfPID=5880, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6424, selfPID=6424, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7000, selfPID=7000, iMonCtr=1 21:08:48 (7704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6264, selfPID=6264, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5200, selfPID=5200, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7416, selfPID=7416, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7580, selfPID=7580, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7864, selfPID=7864, iMonCtr=1 21:49:26 (7572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6136, selfPID=6136, iMonCtr=1 21:59:35 (6348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=704, selfPID=704, iMonCtr=1 22:21:39 (7672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:21:40 (7672): No heartbeat from core client for 30 sec - exiting 22:21:41 (7672): No heartbeat from core client for 30 sec - exiting 22:21:42 (7672): No heartbeat from core client for 30 sec - exiting 22:21:43 (7672): No heartbeat from core client for 30 sec - exiting 22:21:44 (7672): No heartbeat from core client for 30 sec - exiting 22:21:45 (7672): No heartbeat from core client for 30 sec - exiting 22:21:46 (7672): No heartbeat from core client for 30 sec - exiting 22:21:47 (7672): No heartbeat from core client for 30 sec - exiting 22:21:48 (7672): No heartbeat from core client for 30 sec - exiting 22:21:49 (7672): No heartbeat from core client for 30 sec - exiting Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7696, selfPID=7696, iMonCtr=1 22:26:06 (7240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:26:07 (7240): No heartbeat from core client for 30 sec - exiting 22:26:08 (7240): No heartbeat from core client for 30 sec - exiting 22:26:09 (7240): No heartbeat from core client for 30 sec - exiting 22:26:10 (7240): No heartbeat from core client for 30 sec - exiting 22:26:11 (7240): No heartbeat from core client for 30 sec - exiting 22:26:12 (7240): No heartbeat from core client for 30 sec - exiting 22:26:13 (7240): No heartbeat from core client for 30 sec - exiting 22:26:14 (7240): No heartbeat from core client for 30 sec - exiting 22:26:15 (7240): No heartbeat from core client for 30 sec - exiting 22:26:16 (7240): No heartbeat from core client for 30 sec - exiting Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5016, selfPID=5016, iMonCtr=1 22:28:37 (7972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:28:38 (7972): No heartbeat from core client for 30 sec - exiting 22:28:39 (7972): No heartbeat from core client for 30 sec - exiting 22:28:40 (7972): No heartbeat from core client for 30 sec - exiting 22:28:41 (7972): No heartbeat from core client for 30 sec - exiting 22:28:42 (7972): No heartbeat from core client for 30 sec - exiting 22:28:43 (7972): No heartbeat from core client for 30 sec - exiting 22:28:44 (7972): No heartbeat from core client for 30 sec - exiting 22:28:45 (7972): No heartbeat from core client for 30 sec - exiting 22:28:46 (7972): No heartbeat from core client for 30 sec - exiting 22:28:47 (7972): No heartbeat from core client for 30 sec - exiting Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7224, selfPID=7224, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8136, selfPID=8136, iMonCtr=1 22:37:50 (7532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7256, selfPID=7256, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7964, selfPID=7964, iMonCtr=1 CPDN Monitor - Quit request from BOINC... forrtl: severe (47): write to READONLY file, unit 6, file C:\ProgramData\BOINC\projects\climateprediction.net\famous_v491_1999_200_006691275\dataout\stdout_um.txt Image PC Routine Line Source famous_um_6.11_wi 008846D2 Unknown Unknown Unknown Stack trace terminated abnormally. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7072, iMonCtr=1 Model crash detected, will try to restart... forrtl: severe (47): write to READONLY file, unit 6, file C:\ProgramData\BOINC\projects\climateprediction.net\famous_v491_1999_200_006691275\dataout\stdout_um.txt Image PC Routine Line Source famous_um_6.11_wi 008846D2 Unknown Unknown Unknown Stack trace terminated abnormally. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7072, iMonCtr=1 Model crash detected, will try to restart... forrtl: severe (47): write to READONLY file, unit 6, file C:\ProgramData\BOINC\projects\climateprediction.net\famous_v491_1999_200_006691275\dataout\stdout_um.txt Image PC Routine Line Source famous_um_6.11_wi 008846D2 Unknown Unknown Unknown Stack trace terminated abnormally. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7072, iMonCtr=1 Model crash detected, will try to restart... forrtl: severe (47): write to READONLY file, unit 6, file C:\ProgramData\BOINC\projects\climateprediction.net\famous_v491_1999_200_006691275\dataout\stdout_um.txt Image PC Routine Line Source famous_um_6.11_wi 008846D2 Unknown Unknown Unknown Stack trace terminated abnormally. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7072, iMonCtr=1 Model crash detected, will try to restart... forrtl: severe (47): write to READONLY file, unit 6, file C:\ProgramData\BOINC\projects\climateprediction.net\famous_v491_1999_200_006691275\dataout\stdout_um.txt Image PC Routine Line Source famous_um_6.11_wi 008846D2 Unknown Unknown Unknown Stack trace terminated abnormally. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7072, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... forrtl: severe (47): write to READONLY file, unit 6, file C:\ProgramData\BOINC\projects\climateprediction.net\famous_v491_1999_200_006691275\dataout\stdout_um.txt Image PC Routine Line Source famous_um_6.11_wi 008846D2 Unknown Unknown Unknown Stack trace terminated abnormally. No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2708, selfPID=2708, iMonCtr=1 CPDN Monitor - Quit request from BOINC... forrtl: severe (47): write to READONLY file, unit 6, file C:\ProgramData\BOINC\projects\climateprediction.net\famous_v491_1999_200_006691275\dataout\stdout_um.txt Image PC Routine Line Source famous_um_6.11_wi 008846D2 Unknown Unknown Unknown Stack trace terminated abnormally. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7060, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/famous_v491_1999_200_006691275/jobs/afyel.ihist after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/famous_v491_1999_200_006691275/jobs/afyel.ihist after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/famous_v491_1999_200_006691275/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/famous_v491_1999_200_006691275/dataout/ocean_restart.day after 11 attempts Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/pipe_dummy cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/famous_v491_1999_200_006691275/jobs/afyel.ihist after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/famous_v491_1999_200_006691275/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/famous_v491_1999_200_006691275/dataout/ocean_restart.day after 11 attempts Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/pipe_dummy cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/famous_v491_1999_200_006691275/jobs/afyel.ihist after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/famous_v491_1999_200_006691275/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/famous_v491_1999_200_006691275/dataout/ocean_restart.day after 11 attempts Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/pipe_dummy cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/famous_v491_1999_200_006691275/jobs/afyel.ihist after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/famous_v491_1999_200_006691275/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/famous_v491_1999_200_006691275/dataout/ocean_restart.day after 11 attempts CPDN Monitor - Quit request from BOINC... Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/pipe_dummy cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/famous_v491_1999_200_006691275/jobs/afyel.ihist after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/famous_v491_1999_200_006691275/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/famous_v491_1999_200_006691275/dataout/ocean_restart.day after 11 attempts Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/pipe_dummy cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/famous_v491_1999_200_006691275/jobs/afyel.ihist after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/famous_v491_1999_200_006691275/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/famous_v491_1999_200_006691275/dataout/ocean_restart.day after 11 attempts Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/pipe_dummy cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/famous_v491_1999_200_006691275/jobs/afyel.ihist after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/famous_v491_1999_200_006691275/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/famous_v491_1999_200_006691275/dataout/ocean_restart.day after 11 attempts Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/pipe_dummy Sorry, too many model crashes! :-( 11:15:43 (1920): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
08 Sep 2010 14:53:01	1071581	11716147	famous_v491_1999_200_006691275_3	112,346	43,197	0.3845
08 Sep 2010 13:48:30	1071581	11716147	famous_v491_1999_200_006691275_3	102,986	39,574	0.3843
08 Sep 2010 12:46:09	1071581	11716147	famous_v491_1999_200_006691275_3	93,626	35,956	0.3840
08 Sep 2010 11:49:15	1071581	11716147	famous_v491_1999_200_006691275_3	84,266	32,345	0.3838
08 Sep 2010 02:13:37	1071581	11716147	famous_v491_1999_200_006691275_3	74,906	28,621	0.3821
07 Sep 2010 23:44:17	1071581	11716147	famous_v491_1999_200_006691275_3	65,546	24,896	0.3798
07 Sep 2010 22:35:33	1071581	11716147	famous_v491_1999_200_006691275_3	56,186	21,324	0.3795
07 Sep 2010 21:30:06	1071581	11716147	famous_v491_1999_200_006691275_3	46,826	17,755	0.3792
07 Sep 2010 20:26:04	1071581	11716147	famous_v491_1999_200_006691275_3	37,466	14,180	0.3785
07 Sep 2010 19:25:39	1071581	11716147	famous_v491_1999_200_006691275_3	28,106	10,617	0.3777
07 Sep 2010 18:21:16	1071581	11716147	famous_v491_1999_200_006691275_3	18,746	7,031	0.3751
07 Sep 2010 17:04:20	1071581	11716147	famous_v491_1999_200_006691275_3	9,386	3,572	0.3806