Task 13285959

Name	hadcm3n_o5s8_1940_40_007419250_1
Workunit	7616885
Created	24 Aug 2011, 17:14:00 UTC
Sent	24 Aug 2011, 17:14:04 UTC
Report deadline	24 Nov 2011, 0:41:15 UTC
Received	9 Sep 2011, 11:43:42 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	946520
Run time	10 days 0 hours 50 min 43 sec
CPU time	9 days 5 hours 52 min 59 sec
Validate state	Invalid
Credit	5,287.68
Device peak FLOPS	2.64 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.6.38</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:15:12 (2932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o5s8ko.pje8c10 Error converting file to netcdf: dataout/o5s8ko.pie8c10 Error converting file to netcdf: dataout/o5s8ko.pfe8c10 Error converting file to netcdf: dataout/o5s8ka.phe8c10 Error converting file to netcdf: dataout/o5s8ka.pge8c10 Error converting file to netcdf: dataout/o5s8ka.pee8c10 Error converting file to netcdf: dataout/o5s8ka.pde8c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2620, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2620, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2620, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2620, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2620, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2620, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
08 Sep 2011 10:26:23	946520	13285959	hadcm3n_o5s8_1940_40_007419250_1	440,640	773,467	1.7553
07 Sep 2011 10:34:40	946520	13285959	hadcm3n_o5s8_1940_40_007419250_1	414,720	728,684	1.7571
06 Sep 2011 15:46:17	946520	13285959	hadcm3n_o5s8_1940_40_007419250_1	388,800	682,942	1.7565
06 Sep 2011 00:21:22	946520	13285959	hadcm3n_o5s8_1940_40_007419250_1	362,880	638,525	1.7596
05 Sep 2011 08:34:34	946520	13285959	hadcm3n_o5s8_1940_40_007419250_1	336,960	592,112	1.7572
04 Sep 2011 04:29:00	946520	13285959	hadcm3n_o5s8_1940_40_007419250_1	311,040	548,812	1.7644
03 Sep 2011 08:44:56	946520	13285959	hadcm3n_o5s8_1940_40_007419250_1	285,120	503,779	1.7669
02 Sep 2011 08:14:11	946520	13285959	hadcm3n_o5s8_1940_40_007419250_1	259,200	458,677	1.7696
01 Sep 2011 12:40:15	946520	13285959	hadcm3n_o5s8_1940_40_007419250_1	233,280	413,176	1.7712
31 Aug 2011 11:19:15	946520	13285959	hadcm3n_o5s8_1940_40_007419250_1	207,360	368,090	1.7751
30 Aug 2011 18:28:52	946520	13285959	hadcm3n_o5s8_1940_40_007419250_1	181,440	323,092	1.7807
30 Aug 2011 05:40:29	946520	13285959	hadcm3n_o5s8_1940_40_007419250_1	155,520	278,548	1.7911
29 Aug 2011 08:17:17	946520	13285959	hadcm3n_o5s8_1940_40_007419250_1	129,600	232,944	1.7974
28 Aug 2011 01:47:08	946520	13285959	hadcm3n_o5s8_1940_40_007419250_1	103,680	185,492	1.7891
27 Aug 2011 04:11:11	946520	13285959	hadcm3n_o5s8_1940_40_007419250_1	77,760	141,546	1.8203
25 Aug 2011 23:55:14	946520	13285959	hadcm3n_o5s8_1940_40_007419250_1	51,840	95,759	1.8472
25 Aug 2011 09:59:21	946520	13285959	hadcm3n_o5s8_1940_40_007419250_1	25,920	48,233	1.8608