Task 15917091

Name	hadcm3n_38l0_1940_40_008395639_3
Workunit	8546498
Created	14 Aug 2013, 15:19:35 UTC
Sent	15 Aug 2013, 2:15:45 UTC
Report deadline	14 Nov 2013, 9:42:56 UTC
Received	16 Oct 2013, 6:54:54 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1283907
Run time	11 days 14 hours 7 min 20 sec
CPU time	10 days 19 hours 5 min 38 sec
Validate state	Invalid
Credit	7,776.00
Device peak FLOPS	2.73 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> 裝置無法辨識命令。 (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:31:59 (5232): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/38l0ko.pjf8c10 Error converting file to netcdf: dataout/38l0ko.pif8c10 Error converting file to netcdf: dataout/38l0ko.pff8c10 Error converting file to netcdf: dataout/38l0ka.phf8c10 Error converting file to netcdf: dataout/38l0ka.pgf8c10 Error converting file to netcdf: dataout/38l0ka.pef8c10 Error converting file to netcdf: dataout/38l0ka.pdf8c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4112, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4112, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4112, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4112, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4112, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4112, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
10 Oct 2013 13:55:57	1283907	15917091	hadcm3n_38l0_1940_40_008395639_3	648,000	915,506	1.4128
10 Oct 2013 02:32:42	1283907	15917091	hadcm3n_38l0_1940_40_008395639_3	622,080	878,496	1.4122
09 Oct 2013 03:40:41	1283907	15917091	hadcm3n_38l0_1940_40_008395639_3	596,160	843,017	1.4141
08 Oct 2013 17:19:40	1283907	15917091	hadcm3n_38l0_1940_40_008395639_3	570,240	807,741	1.4165
07 Oct 2013 21:01:33	1283907	15917091	hadcm3n_38l0_1940_40_008395639_3	544,320	767,777	1.4105
07 Oct 2013 11:12:08	1283907	15917091	hadcm3n_38l0_1940_40_008395639_3	518,400	733,284	1.4145
07 Oct 2013 00:59:49	1283907	15917091	hadcm3n_38l0_1940_40_008395639_3	492,480	698,942	1.4192
06 Oct 2013 04:17:11	1283907	15917091	hadcm3n_38l0_1940_40_008395639_3	466,560	661,071	1.4169
19 Sep 2013 18:38:36	1283907	15917091	hadcm3n_38l0_1940_40_008395639_3	440,640	624,244	1.4167
19 Sep 2013 07:47:06	1283907	15917091	hadcm3n_38l0_1940_40_008395639_3	414,720	587,369	1.4163
18 Sep 2013 20:54:07	1283907	15917091	hadcm3n_38l0_1940_40_008395639_3	388,800	550,533	1.4160
18 Sep 2013 10:38:58	1283907	15917091	hadcm3n_38l0_1940_40_008395639_3	362,880	513,857	1.4161
17 Sep 2013 22:10:21	1283907	15917091	hadcm3n_38l0_1940_40_008395639_3	336,960	476,980	1.4155
17 Sep 2013 11:11:48	1283907	15917091	hadcm3n_38l0_1940_40_008395639_3	311,040	440,003	1.4146
16 Sep 2013 03:34:36	1283907	15917091	hadcm3n_38l0_1940_40_008395639_3	285,120	403,267	1.4144
15 Sep 2013 16:46:25	1283907	15917091	hadcm3n_38l0_1940_40_008395639_3	259,200	366,353	1.4134
15 Sep 2013 06:08:14	1283907	15917091	hadcm3n_38l0_1940_40_008395639_3	233,280	329,572	1.4128
14 Sep 2013 18:55:28	1283907	15917091	hadcm3n_38l0_1940_40_008395639_3	207,360	292,753	1.4118
14 Sep 2013 08:32:54	1283907	15917091	hadcm3n_38l0_1940_40_008395639_3	181,440	256,723	1.4149
04 Sep 2013 23:15:56	1283907	15917091	hadcm3n_38l0_1940_40_008395639_3	155,520	216,536	1.3923