Task 15764360

Name	hadcm3n_o4ax_2140_40_008270128_3
Workunit	8425252
Created	6 May 2013, 19:12:06 UTC
Sent	6 May 2013, 19:12:14 UTC
Report deadline	6 Aug 2013, 2:39:25 UTC
Received	20 May 2013, 7:14:22 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1253782
Run time	13 days 6 hours 24 min 34 sec
CPU time	9 days 6 hours 24 min 4 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	3.04 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=11760, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... MainError: 03:06:28 PM No files match the supplied pattern. MainError: 03:06:28 PM No files match the supplied pattern. MainError: 02:00:12 AM No files match the supplied pattern. MainError: 02:00:12 AM No files match the supplied pattern. Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7640, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... MainError: 04:19:44 PM No files match the supplied pattern. MainError: 04:19:44 PM No files match the supplied pattern. Suspended CPDN Monitor - Suspend request from BOINC... MainError: 02:59:46 AM No files match the supplied pattern. MainError: 02:59:46 AM No files match the supplied pattern. Suspended CPDN Monitor - Suspend request from BOINC... MainError: 01:46:01 PM No files match the supplied pattern. MainError: 01:46:01 PM No files match the supplied pattern. Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... MainError: 12:20:05 AM No files match the supplied pattern. MainError: 12:20:05 AM No files match the supplied pattern. MainError: 10:52:35 AM No files match the supplied pattern. MainError: 10:52:35 AM No files match the supplied pattern. MainError: 09:40:10 PM No files match the supplied pattern. MainError: 09:40:10 PM No files match the supplied pattern. MainError: 08:25:35 AM No files match the supplied pattern. MainError: 08:25:35 AM No files match the supplied pattern. MainError: 07:14:16 PM No files match the supplied pattern. MainError: 07:14:16 PM No files match the supplied pattern. Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Error converting file to netcdf: dataout/o4axka.ph11c10 Error converting file to netcdf: dataout/o4axka.pg11c10 Error converting file to netcdf: dataout/o4axka.pe11c10 MainError: 06:13:35 AM No files match the supplied pattern. MainError: 06:13:35 AM No files match the supplied pattern. BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
20 May 2013 06:15:03	1253782	15764360	hadcm3n_o4ax_2140_40_008270128_3	777,600	1,124,770	1.4465
19 May 2013 19:18:24	1253782	15764360	hadcm3n_o4ax_2140_40_008270128_3	751,680	1,086,171	1.4450
19 May 2013 08:27:04	1253782	15764360	hadcm3n_o4ax_2140_40_008270128_3	725,760	1,047,819	1.4438
18 May 2013 21:42:55	1253782	15764360	hadcm3n_o4ax_2140_40_008270128_3	699,840	1,009,697	1.4428
18 May 2013 11:49:48	1253782	15764360	hadcm3n_o4ax_2140_40_008270128_3	673,920	971,541	1.4416
18 May 2013 00:45:35	1253782	15764360	hadcm3n_o4ax_2140_40_008270128_3	648,000	933,767	1.4410
17 May 2013 13:47:19	1253782	15764360	hadcm3n_o4ax_2140_40_008270128_3	622,080	896,008	1.4403
17 May 2013 03:03:04	1253782	15764360	hadcm3n_o4ax_2140_40_008270128_3	596,160	857,631	1.4386
16 May 2013 16:21:33	1253782	15764360	hadcm3n_o4ax_2140_40_008270128_3	570,240	819,915	1.4378
16 May 2013 02:04:48	1253782	15764360	hadcm3n_o4ax_2140_40_008270128_3	544,320	782,005	1.4367
15 May 2013 15:07:45	1253782	15764360	hadcm3n_o4ax_2140_40_008270128_3	518,400	743,603	1.4344
15 May 2013 04:18:59	1253782	15764360	hadcm3n_o4ax_2140_40_008270128_3	492,480	705,519	1.4326
14 May 2013 17:32:46	1253782	15764360	hadcm3n_o4ax_2140_40_008270128_3	466,560	667,366	1.4304
14 May 2013 06:48:01	1253782	15764360	hadcm3n_o4ax_2140_40_008270128_3	440,640	629,154	1.4278
13 May 2013 19:53:33	1253782	15764360	hadcm3n_o4ax_2140_40_008270128_3	414,720	590,963	1.4250
13 May 2013 09:03:49	1253782	15764360	hadcm3n_o4ax_2140_40_008270128_3	388,800	552,634	1.4214
12 May 2013 21:53:21	1253782	15764360	hadcm3n_o4ax_2140_40_008270128_3	362,880	513,677	1.4156
12 May 2013 11:01:47	1253782	15764360	hadcm3n_o4ax_2140_40_008270128_3	336,960	475,591	1.4114
12 May 2013 00:12:52	1253782	15764360	hadcm3n_o4ax_2140_40_008270128_3	311,040	437,190	1.4056
11 May 2013 13:39:57	1253782	15764360	hadcm3n_o4ax_2140_40_008270128_3	285,120	399,778	1.4021