Task 14841029

Name	hadcm3n_o2dx_2100_40_008026053_1
Workunit	8181167
Created	25 Jun 2012, 3:04:17 UTC
Sent	25 Jun 2012, 3:04:21 UTC
Report deadline	24 Sep 2012, 10:31:32 UTC
Received	31 Aug 2012, 3:29:55 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1221366
Run time	17 days 6 hours 2 min 54 sec
CPU time	15 days 9 hours 57 min 39 sec
Validate state	Invalid
Credit	10,886.40
Device peak FLOPS	2.27 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o2dxko.pju3c10 Error converting file to netcdf: dataout/o2dxko.piu3c10 Error converting file to netcdf: dataout/o2dxko.pfu3c10 Error converting file to netcdf: dataout/o2dxka.phu3c10 Error converting file to netcdf: dataout/o2dxka.pgu3c10 Error converting file to netcdf: dataout/o2dxka.peu3c10 Error converting file to netcdf: dataout/o2dxka.pdu3c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o2dxko.pjv8c10 Error converting file to netcdf: dataout/o2dxko.piv8c10 Error converting file to netcdf: dataout/o2dxko.pfv8c10 Error converting file to netcdf: dataout/o2dxka.phv8c10 Error converting file to netcdf: dataout/o2dxka.pgv8c10 Error converting file to netcdf: dataout/o2dxka.pev8c10 Error converting file to netcdf: dataout/o2dxka.pdv8c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4576, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1828, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1828, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1828, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1828, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1828, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5436, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 Aug 2012 00:28:21	1221366	14841029	hadcm3n_o2dx_2100_40_008026053_1	907,200	1,294,430	1.4268
26 Aug 2012 20:07:21	1221366	14841029	hadcm3n_o2dx_2100_40_008026053_1	881,280	1,257,497	1.4269
26 Aug 2012 07:50:05	1221366	14841029	hadcm3n_o2dx_2100_40_008026053_1	855,360	1,219,613	1.4258
25 Aug 2012 20:01:42	1221366	14841029	hadcm3n_o2dx_2100_40_008026053_1	829,440	1,182,148	1.4252
24 Aug 2012 18:38:05	1221366	14841029	hadcm3n_o2dx_2100_40_008026053_1	803,520	1,145,696	1.4258
23 Aug 2012 16:23:21	1221366	14841029	hadcm3n_o2dx_2100_40_008026053_1	777,600	1,111,066	1.4288
23 Aug 2012 05:40:44	1221366	14841029	hadcm3n_o2dx_2100_40_008026053_1	751,680	1,078,889	1.4353
22 Aug 2012 01:39:38	1221366	14841029	hadcm3n_o2dx_2100_40_008026053_1	725,760	1,034,645	1.4256
21 Aug 2012 22:23:52	1221366	14841029	hadcm3n_o2dx_2100_40_008026053_1	699,840	995,588	1.4226
21 Aug 2012 22:23:52	1221366	14841029	hadcm3n_o2dx_2100_40_008026053_1	673,920	958,671	1.4225
21 Aug 2012 22:23:52	1221366	14841029	hadcm3n_o2dx_2100_40_008026053_1	648,000	919,243	1.4186
13 Aug 2012 03:03:10	1221366	14841029	hadcm3n_o2dx_2100_40_008026053_1	622,080	876,658	1.4092
27 Jul 2012 23:37:18	1221366	14841029	hadcm3n_o2dx_2100_40_008026053_1	596,160	833,986	1.3989
23 Jul 2012 23:36:57	1221366	14841029	hadcm3n_o2dx_2100_40_008026053_1	570,240	791,482	1.3880
22 Jul 2012 03:45:57	1221366	14841029	hadcm3n_o2dx_2100_40_008026053_1	544,320	753,829	1.3849
20 Jul 2012 22:34:09	1221366	14841029	hadcm3n_o2dx_2100_40_008026053_1	518,400	718,681	1.3863
20 Jul 2012 06:31:41	1221366	14841029	hadcm3n_o2dx_2100_40_008026053_1	492,480	684,265	1.3894
16 Jul 2012 15:12:47	1221366	14841029	hadcm3n_o2dx_2100_40_008026053_1	466,560	649,938	1.3930
16 Jul 2012 00:54:35	1221366	14841029	hadcm3n_o2dx_2100_40_008026053_1	440,640	616,056	1.3981
15 Jul 2012 12:58:05	1221366	14841029	hadcm3n_o2dx_2100_40_008026053_1	414,720	581,814	1.4029