Task 13923253

Name	hadcm3n_ymrd_1940_40_007682223_0
Workunit	7837310
Created	15 Jan 2012, 22:16:06 UTC
Sent	15 Jan 2012, 22:16:11 UTC
Report deadline	16 Apr 2012, 5:43:22 UTC
Received	16 Feb 2012, 13:28:42 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1160549
Run time	13 days 23 hours 56 min 57 sec
CPU time	12 days 22 hours 5 min 57 sec
Validate state	Invalid
Credit	10,886.40
Device peak FLOPS	3.27 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:13:32 (7004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/ymrdko.pje7c10 Error converting file to netcdf: dataout/ymrdko.pie7c10 Error converting file to netcdf: dataout/ymrdko.pfe7c10 Error converting file to netcdf: dataout/ymrdka.phe7c10 Error converting file to netcdf: dataout/ymrdka.pge7c10 Error converting file to netcdf: dataout/ymrdka.pee7c10 Error converting file to netcdf: dataout/ymrdka.pde7c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4336, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4336, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4336, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4336, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4336, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4336, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
16 Feb 2012 00:44:35	1160549	13923253	hadcm3n_ymrd_1940_40_007682223_0	907,200	1,111,038	1.2247
15 Feb 2012 15:19:41	1160549	13923253	hadcm3n_ymrd_1940_40_007682223_0	881,280	1,079,799	1.2253
15 Feb 2012 05:42:35	1160549	13923253	hadcm3n_ymrd_1940_40_007682223_0	855,360	1,048,694	1.2260
14 Feb 2012 20:07:37	1160549	13923253	hadcm3n_ymrd_1940_40_007682223_0	829,440	1,015,843	1.2247
14 Feb 2012 08:45:15	1160549	13923253	hadcm3n_ymrd_1940_40_007682223_0	803,520	983,656	1.2242
13 Feb 2012 22:55:36	1160549	13923253	hadcm3n_ymrd_1940_40_007682223_0	777,600	951,863	1.2241
13 Feb 2012 13:23:22	1160549	13923253	hadcm3n_ymrd_1940_40_007682223_0	751,680	920,305	1.2243
13 Feb 2012 05:42:37	1160549	13923253	hadcm3n_ymrd_1940_40_007682223_0	725,760	888,587	1.2244
12 Feb 2012 20:00:01	1160549	13923253	hadcm3n_ymrd_1940_40_007682223_0	699,840	856,427	1.2237
12 Feb 2012 10:15:19	1160549	13923253	hadcm3n_ymrd_1940_40_007682223_0	673,920	824,900	1.2240
11 Feb 2012 23:12:17	1160549	13923253	hadcm3n_ymrd_1940_40_007682223_0	648,000	791,847	1.2220
11 Feb 2012 12:54:17	1160549	13923253	hadcm3n_ymrd_1940_40_007682223_0	622,080	759,988	1.2217
11 Feb 2012 02:42:27	1160549	13923253	hadcm3n_ymrd_1940_40_007682223_0	596,160	727,614	1.2205
10 Feb 2012 21:14:52	1160549	13923253	hadcm3n_ymrd_1940_40_007682223_0	570,240	693,905	1.2169
09 Feb 2012 10:53:02	1160549	13923253	hadcm3n_ymrd_1940_40_007682223_0	544,320	661,584	1.2154
09 Feb 2012 00:47:11	1160549	13923253	hadcm3n_ymrd_1940_40_007682223_0	518,400	628,010	1.2114
08 Feb 2012 15:35:39	1160549	13923253	hadcm3n_ymrd_1940_40_007682223_0	492,480	597,774	1.2138
06 Feb 2012 19:42:00	1160549	13923253	hadcm3n_ymrd_1940_40_007682223_0	466,560	566,093	1.2133
04 Feb 2012 01:18:35	1160549	13923253	hadcm3n_ymrd_1940_40_007682223_0	440,640	534,703	1.2135
03 Feb 2012 09:34:41	1160549	13923253	hadcm3n_ymrd_1940_40_007682223_0	414,720	503,738	1.2146