Task 15806953

Name	hadcm3n_n5gk_1920_40_008377509_0
Workunit	8528368
Created	30 May 2013, 12:05:09 UTC
Sent	30 May 2013, 20:22:01 UTC
Report deadline	30 Aug 2013, 3:49:12 UTC
Received	20 Jun 2013, 22:16:04 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1183659
Run time	11 days 8 hours 46 min 3 sec
CPU time	9 days 15 hours 12 min 42 sec
Validate state	Invalid
Credit	5,909.76
Device peak FLOPS	2.61 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=21572, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:47:45 (2292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:55:54 (2880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3604, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3604, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3604, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3604, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3604, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3604, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
20 Jun 2013 21:26:39	1183659	15806953	hadcm3n_n5gk_1920_40_008377509_0	492,480	832,441	1.6903
19 Jun 2013 18:43:04	1183659	15806953	hadcm3n_n5gk_1920_40_008377509_0	466,560	788,118	1.6892
17 Jun 2013 06:19:58	1183659	15806953	hadcm3n_n5gk_1920_40_008377509_0	440,640	744,742	1.6901
16 Jun 2013 00:37:21	1183659	15806953	hadcm3n_n5gk_1920_40_008377509_0	414,720	703,718	1.6969
15 Jun 2013 10:25:20	1183659	15806953	hadcm3n_n5gk_1920_40_008377509_0	388,800	660,736	1.6994
13 Jun 2013 22:46:54	1183659	15806953	hadcm3n_n5gk_1920_40_008377509_0	362,880	615,906	1.6973
13 Jun 2013 07:23:18	1183659	15806953	hadcm3n_n5gk_1920_40_008377509_0	336,960	572,110	1.6979
12 Jun 2013 16:33:09	1183659	15806953	hadcm3n_n5gk_1920_40_008377509_0	311,040	527,143	1.6948
11 Jun 2013 22:45:46	1183659	15806953	hadcm3n_n5gk_1920_40_008377509_0	285,120	482,083	1.6908
10 Jun 2013 09:58:19	1183659	15806953	hadcm3n_n5gk_1920_40_008377509_0	259,200	440,596	1.6998
07 Jun 2013 03:58:25	1183659	15806953	hadcm3n_n5gk_1920_40_008377509_0	233,280	398,169	1.7068
06 Jun 2013 10:01:48	1183659	15806953	hadcm3n_n5gk_1920_40_008377509_0	207,360	355,210	1.7130
05 Jun 2013 03:17:59	1183659	15806953	hadcm3n_n5gk_1920_40_008377509_0	181,440	311,660	1.7177
04 Jun 2013 07:44:23	1183659	15806953	hadcm3n_n5gk_1920_40_008377509_0	155,520	266,047	1.7107
03 Jun 2013 04:09:51	1183659	15806953	hadcm3n_n5gk_1920_40_008377509_0	129,600	223,296	1.7230
02 Jun 2013 11:24:40	1183659	15806953	hadcm3n_n5gk_1920_40_008377509_0	103,680	178,815	1.7247
01 Jun 2013 18:46:50	1183659	15806953	hadcm3n_n5gk_1920_40_008377509_0	77,760	131,132	1.6864
01 Jun 2013 02:08:30	1183659	15806953	hadcm3n_n5gk_1920_40_008377509_0	51,840	86,151	1.6619
31 May 2013 13:28:03	1183659	15806953	hadcm3n_n5gk_1920_40_008377509_0	25,920	44,352	1.7111