Task 15561162

Name	hadcm3n_o5ab_2140_40_008269808_1
Workunit	8424932
Created	30 Jan 2013, 7:26:14 UTC
Sent	30 Jan 2013, 7:26:19 UTC
Report deadline	1 May 2013, 14:53:30 UTC
Received	17 Feb 2013, 10:37:12 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1346606
Run time	15 days 20 hours 54 min 39 sec
CPU time	12 days 22 hours 23 min 23 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	2.76 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6628, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6628, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6628, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6432, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6432, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6432, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... MainError: 05:40:33 AM No files match the supplied pattern. MainError: 05:40:33 AM No files match the supplied pattern. MainError: 02:41:51 PM No files match the supplied pattern. MainError: 02:41:51 PM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... MainError: 11:26:54 PM No files match the supplied pattern. MainError: 11:26:54 PM No files match the supplied pattern. MainError: 08:11:41 AM No files match the supplied pattern. MainError: 08:11:41 AM No files match the supplied pattern. MainError: 04:40:53 PM No files match the supplied pattern. MainError: 04:40:53 PM No files match the supplied pattern. MainError: 12:53:35 AM No files match the supplied pattern. MainError: 12:53:35 AM No files match the supplied pattern. MainError: 09:54:03 AM No files match the supplied pattern. MainError: 09:54:03 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... MainError: 07:44:16 AM No files match the supplied pattern. MainError: 07:44:16 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... MainError: 05:40:05 AM No files match the supplied pattern. MainError: 05:40:05 AM No files match the supplied pattern. MainError: 05:01:54 AM No files match the supplied pattern. MainError: 05:01:54 AM No files match the supplied pattern. Error converting file to netcdf: dataout/o5abka.ph11c10 Error converting file to netcdf: dataout/o5abka.pg11c10 Error converting file to netcdf: dataout/o5abka.pe11c10 MainError: 04:56:24 AM No files match the supplied pattern. MainError: 04:56:24 AM No files match the supplied pattern. BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
17 Feb 2013 05:31:19	1168134	15561162	hadcm3n_o5ab_2140_40_008269808_1	777,600	1,232,851	1.5855
16 Feb 2013 05:28:15	1168134	15561162	hadcm3n_o5ab_2140_40_008269808_1	751,680	1,188,233	1.5808
15 Feb 2013 05:41:32	1168134	15561162	hadcm3n_o5ab_2140_40_008269808_1	725,760	1,143,212	1.5752
14 Feb 2013 07:45:30	1168134	15561162	hadcm3n_o5ab_2140_40_008269808_1	699,840	1,096,334	1.5665
12 Feb 2013 10:09:55	1168134	15561162	hadcm3n_o5ab_2140_40_008269808_1	673,920	1,059,190	1.5717
12 Feb 2013 01:02:47	1168134	15561162	hadcm3n_o5ab_2140_40_008269808_1	648,000	1,026,779	1.5845
11 Feb 2013 16:41:01	1168134	15561162	hadcm3n_o5ab_2140_40_008269808_1	622,080	997,243	1.6031
11 Feb 2013 08:16:04	1168134	15561162	hadcm3n_o5ab_2140_40_008269808_1	596,160	966,703	1.6215
10 Feb 2013 23:29:01	1168134	15561162	hadcm3n_o5ab_2140_40_008269808_1	570,240	935,289	1.6402
10 Feb 2013 14:45:40	1168134	15561162	hadcm3n_o5ab_2140_40_008269808_1	544,320	903,981	1.6608
10 Feb 2013 05:41:14	1168134	15561162	hadcm3n_o5ab_2140_40_008269808_1	518,400	871,519	1.6812
09 Feb 2013 20:32:11	1168134	15561162	hadcm3n_o5ab_2140_40_008269808_1	492,480	838,500	1.7026
09 Feb 2013 11:22:27	1168134	15561162	hadcm3n_o5ab_2140_40_008269808_1	466,560	805,444	1.7263
09 Feb 2013 02:10:13	1168134	15561162	hadcm3n_o5ab_2140_40_008269808_1	440,640	772,308	1.7527
08 Feb 2013 16:56:08	1168134	15561162	hadcm3n_o5ab_2140_40_008269808_1	414,720	739,189	1.7824
08 Feb 2013 07:36:38	1168134	15561162	hadcm3n_o5ab_2140_40_008269808_1	388,800	706,080	1.8160
07 Feb 2013 22:27:48	1168134	15561162	hadcm3n_o5ab_2140_40_008269808_1	362,880	672,986	1.8546
07 Feb 2013 13:15:35	1168134	15561162	hadcm3n_o5ab_2140_40_008269808_1	336,960	639,894	1.8990
07 Feb 2013 04:06:20	1168134	15561162	hadcm3n_o5ab_2140_40_008269808_1	311,040	606,910	1.9512
06 Feb 2013 18:58:17	1168134	15561162	hadcm3n_o5ab_2140_40_008269808_1	285,120	573,960	2.0130