Task 15677329

Name	hadcm3n_o3d2_2060_40_008334238_0
Workunit	8485099
Created	22 Mar 2013, 22:40:09 UTC
Sent	22 Mar 2013, 22:40:19 UTC
Report deadline	22 Jun 2013, 6:07:30 UTC
Received	14 Apr 2013, 0:17:45 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1240331
Run time	6 days 10 hours 25 min 23 sec
CPU time	6 days 2 hours 48 min 32 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.63 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2236, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2160, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3d2ko.pjq3c10 Error converting file to netcdf: dataout/o3d2ko.piq3c10 Error converting file to netcdf: dataout/o3d2ko.pfq3c10 Error converting file to netcdf: dataout/o3d2ka.phq3c10 Error converting file to netcdf: dataout/o3d2ka.pgq3c10 Error converting file to netcdf: dataout/o3d2ka.peq3c10 Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3048, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3048, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1752, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1752, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1752, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1484, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1484, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1484, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
12 Apr 2013 00:56:35	1240331	15677329	hadcm3n_o3d2_2060_40_008334238_0	259,200	519,898	2.0058
09 Apr 2013 12:16:18	1240331	15677329	hadcm3n_o3d2_2060_40_008334238_0	233,280	467,584	2.0044
07 Apr 2013 03:56:18	1240331	15677329	hadcm3n_o3d2_2060_40_008334238_0	207,360	415,494	2.0037
06 Apr 2013 10:24:14	1240331	15677329	hadcm3n_o3d2_2060_40_008334238_0	181,440	363,652	2.0043
05 Apr 2013 06:08:31	1240331	15677329	hadcm3n_o3d2_2060_40_008334238_0	155,520	311,865	2.0053
03 Apr 2013 08:10:19	1240331	15677329	hadcm3n_o3d2_2060_40_008334238_0	129,600	260,326	2.0087
02 Apr 2013 00:45:37	1240331	15677329	hadcm3n_o3d2_2060_40_008334238_0	103,680	208,429	2.0103
31 Mar 2013 23:00:48	1240331	15677329	hadcm3n_o3d2_2060_40_008334238_0	77,760	156,586	2.0137
29 Mar 2013 22:50:58	1240331	15677329	hadcm3n_o3d2_2060_40_008334238_0	51,840	104,525	2.0163
25 Mar 2013 02:15:38	1240331	15677329	hadcm3n_o3d2_2060_40_008334238_0	25,920	52,175	2.0129