Task 12973870

Name	hadcm3n_o5ur_1940_40_007266381_2
Workunit	7464621
Created	12 Jun 2011, 17:39:02 UTC
Sent	12 Jun 2011, 17:39:06 UTC
Report deadline	12 Sep 2011, 1:06:17 UTC
Received	23 Jul 2011, 13:15:23 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1062163
Run time	10 days 6 hours 52 min 13 sec
CPU time	9 days 4 hours 19 min 38 sec
Validate state	Invalid
Credit	6,531.84
Device peak FLOPS	2.96 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.60</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:57:47 (5260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:57:49 (5260): No heartbeat from core client for 30 sec - exiting 21:57:50 (5260): No heartbeat from core client for 30 sec - exiting 21:57:51 (5260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5284, selfPID=5284, iMonCtr=1 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o5urko.pjf4c10 Error converting file to netcdf: dataout/o5urko.pif4c10 Error converting file to netcdf: dataout/o5urko.pff4c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:00:40 (5200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:00:41 (5200): No heartbeat from core client for 30 sec - exiting 21:00:42 (5200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5224, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5224, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5224, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5224, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5224, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3048, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
10 Jul 2011 01:39:05	1062163	12973870	hadcm3n_o5ur_1940_40_007266381_2	544,320	771,479	1.4173
08 Jul 2011 19:13:43	1062163	12973870	hadcm3n_o5ur_1940_40_007266381_2	518,400	732,384	1.4128
08 Jul 2011 09:03:59	1062163	12973870	hadcm3n_o5ur_1940_40_007266381_2	492,480	696,682	1.4146
07 Jul 2011 20:08:50	1062163	12973870	hadcm3n_o5ur_1940_40_007266381_2	466,560	660,135	1.4149
07 Jul 2011 17:46:05	1062163	12973870	hadcm3n_o5ur_1940_40_007266381_2	440,640	623,686	1.4154
05 Jul 2011 19:30:43	1062163	12973870	hadcm3n_o5ur_1940_40_007266381_2	414,720	585,878	1.4127
03 Jul 2011 22:26:26	1062163	12973870	hadcm3n_o5ur_1940_40_007266381_2	388,800	548,377	1.4104
02 Jul 2011 00:00:04	1062163	12973870	hadcm3n_o5ur_1940_40_007266381_2	362,880	509,693	1.4046
29 Jun 2011 17:20:03	1062163	12973870	hadcm3n_o5ur_1940_40_007266381_2	336,960	473,601	1.4055
28 Jun 2011 19:56:15	1062163	12973870	hadcm3n_o5ur_1940_40_007266381_2	311,040	437,348	1.4061
27 Jun 2011 23:32:33	1062163	12973870	hadcm3n_o5ur_1940_40_007266381_2	285,120	400,471	1.4046
26 Jun 2011 01:08:21	1062163	12973870	hadcm3n_o5ur_1940_40_007266381_2	259,200	364,036	1.4045
24 Jun 2011 21:02:17	1062163	12973870	hadcm3n_o5ur_1940_40_007266381_2	233,280	326,949	1.4015
22 Jun 2011 18:56:25	1062163	12973870	hadcm3n_o5ur_1940_40_007266381_2	207,360	290,384	1.4004
21 Jun 2011 22:16:44	1062163	12973870	hadcm3n_o5ur_1940_40_007266381_2	181,440	254,036	1.4001
21 Jun 2011 10:35:01	1062163	12973870	hadcm3n_o5ur_1940_40_007266381_2	155,520	217,653	1.3995
20 Jun 2011 19:41:19	1062163	12973870	hadcm3n_o5ur_1940_40_007266381_2	129,600	181,558	1.4009
20 Jun 2011 01:47:50	1062163	12973870	hadcm3n_o5ur_1940_40_007266381_2	103,680	145,993	1.4081
19 Jun 2011 22:17:46	1062163	12973870	hadcm3n_o5ur_1940_40_007266381_2	77,760	109,726	1.4111
15 Jun 2011 02:32:09	1062163	12973870	hadcm3n_o5ur_1940_40_007266381_2	51,840	73,284	1.4137