Task 15682826

Name	hadcm3n_o6y5_2140_40_008269702_1
Workunit	8424826
Created	25 Mar 2013, 15:26:20 UTC
Sent	25 Mar 2013, 15:26:22 UTC
Report deadline	24 Jun 2013, 22:53:33 UTC
Received	27 Apr 2013, 11:56:25 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1262806
Run time	6 days 19 hours 42 min 55 sec
CPU time	5 days 16 hours 44 min 59 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	3.62 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4676, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... MainError: 07:19:04 PM No files match the supplied pattern. MainError: 07:19:04 PM No files match the supplied pattern. MainError: 11:39:58 AM No files match the supplied pattern. MainError: 11:39:58 AM No files match the supplied pattern. MainError: 05:05:28 PM No files match the supplied pattern. MainError: 05:05:28 PM No files match the supplied pattern. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1156, iMonCtr=1 Model crash detected, will try to restart... MainError: 01:51:06 PM No files match the supplied pattern. MainError: 01:51:06 PM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... MainError: 08:56:28 PM No files match the supplied pattern. MainError: 08:56:28 PM No files match the supplied pattern. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4048, iMonCtr=1 Model crash detected, will try to restart... MainError: 02:14:16 PM No files match the supplied pattern. MainError: 02:14:16 PM No files match the supplied pattern. MainError: 06:41:02 PM No files match the supplied pattern. MainError: 06:41:02 PM No files match the supplied pattern. MainError: 05:53:24 PM No files match the supplied pattern. MainError: 05:53:24 PM No files match the supplied pattern. MainError: 11:32:13 PM No files match the supplied pattern. MainError: 11:32:13 PM No files match the supplied pattern. MainError: 05:09:10 AM No files match the supplied pattern. MainError: 05:09:10 AM No files match the supplied pattern. Error converting file to netcdf: dataout/o6y5ka.ph11c10 Error converting file to netcdf: dataout/o6y5ka.pg11c10 Error converting file to netcdf: dataout/o6y5ka.pe11c10 MainError: 10:55:47 AM No files match the supplied pattern. MainError: 10:55:47 AM No files match the supplied pattern. BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
27 Apr 2013 10:58:37	1262806	15682826	hadcm3n_o6y5_2140_40_008269702_1	777,600	562,368	0.7232
27 Apr 2013 05:11:54	1262806	15682826	hadcm3n_o6y5_2140_40_008269702_1	751,680	543,161	0.7226
26 Apr 2013 23:34:54	1262806	15682826	hadcm3n_o6y5_2140_40_008269702_1	725,760	524,084	0.7221
26 Apr 2013 18:24:28	1262806	15682826	hadcm3n_o6y5_2140_40_008269702_1	699,840	504,809	0.7213
25 Apr 2013 19:31:36	1262806	15682826	hadcm3n_o6y5_2140_40_008269702_1	673,920	485,918	0.7210
24 Apr 2013 14:25:29	1262806	15682826	hadcm3n_o6y5_2140_40_008269702_1	648,000	466,976	0.7206
23 Apr 2013 04:47:43	1262806	15682826	hadcm3n_o6y5_2140_40_008269702_1	622,080	448,000	0.7202
22 Apr 2013 14:25:35	1262806	15682826	hadcm3n_o6y5_2140_40_008269702_1	596,160	428,975	0.7196
21 Apr 2013 17:44:15	1262806	15682826	hadcm3n_o6y5_2140_40_008269702_1	570,240	410,130	0.7192
21 Apr 2013 11:42:57	1262806	15682826	hadcm3n_o6y5_2140_40_008269702_1	544,320	391,197	0.7187
20 Apr 2013 19:56:14	1262806	15682826	hadcm3n_o6y5_2140_40_008269702_1	518,400	372,326	0.7182
19 Apr 2013 21:14:36	1262806	15682826	hadcm3n_o6y5_2140_40_008269702_1	492,480	353,532	0.7179
19 Apr 2013 16:10:54	1262806	15682826	hadcm3n_o6y5_2140_40_008269702_1	466,560	334,555	0.7171
17 Apr 2013 20:32:59	1262806	15682826	hadcm3n_o6y5_2140_40_008269702_1	440,640	315,734	0.7165
16 Apr 2013 19:20:09	1262806	15682826	hadcm3n_o6y5_2140_40_008269702_1	414,720	297,048	0.7163
15 Apr 2013 21:19:24	1262806	15682826	hadcm3n_o6y5_2140_40_008269702_1	388,800	278,382	0.7160
15 Apr 2013 15:51:15	1262806	15682826	hadcm3n_o6y5_2140_40_008269702_1	362,880	259,724	0.7157
14 Apr 2013 19:49:52	1262806	15682826	hadcm3n_o6y5_2140_40_008269702_1	336,960	241,135	0.7156
12 Apr 2013 21:03:53	1262806	15682826	hadcm3n_o6y5_2140_40_008269702_1	311,040	222,531	0.7154
12 Apr 2013 15:45:49	1262806	15682826	hadcm3n_o6y5_2140_40_008269702_1	285,120	203,865	0.7150