Task 16585430

Name	hadcm3n_88nt_1980_40_008720644_0
Workunit	8866622
Created	23 Apr 2014, 12:25:40 UTC
Sent	5 May 2014, 19:08:53 UTC
Report deadline	5 Aug 2014, 2:36:04 UTC
Received	10 Jun 2014, 1:51:20 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1325094
Run time	8 days 2 hours 17 min 46 sec
CPU time	7 days 18 hours 29 min 33 sec
Validate state	Invalid
Credit	7,464.96
Device peak FLOPS	3.53 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> 01:03:51 (3420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:03:52 (3420): No heartbeat from core client for 30 sec - exiting 01:03:53 (3420): No heartbeat from core client for 30 sec - exiting 01:03:54 (3420): No heartbeat from core client for 30 sec - exiting 01:03:55 (3420): No heartbeat from core client for 30 sec - exiting 01:03:56 (3420): No heartbeat from core client for 30 sec - exiting 01:03:58 (3420): No heartbeat from core client for 30 sec - exiting 01:03:59 (3420): No heartbeat from core client for 30 sec - exiting 01:04:00 (3420): No heartbeat from core client for 30 sec - exiting 01:04:01 (3420): No heartbeat from core client for 30 sec - exiting 01:03:41 (5476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:03:42 (5476): No heartbeat from core client for 30 sec - exiting 01:03:43 (5476): No heartbeat from core client for 30 sec - exiting 01:03:44 (5476): No heartbeat from core client for 30 sec - exiting 01:03:45 (5476): No heartbeat from core client for 30 sec - exiting 01:03:46 (5476): No heartbeat from core client for 30 sec - exiting 01:03:47 (5476): No heartbeat from core client for 30 sec - exiting 01:03:48 (5476): No heartbeat from core client for 30 sec - exiting 01:03:49 (5476): No heartbeat from core client for 30 sec - exiting 01:03:51 (5476): No heartbeat from core client for 30 sec - exiting 01:03:52 (5476): No heartbeat from core client for 30 sec - exiting 04:25:34 (6124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:06:41 (1972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:06:42 (1972): No heartbeat from core client for 30 sec - exiting 01:06:44 (1972): No heartbeat from core client for 30 sec - exiting 01:06:45 (1972): No heartbeat from core client for 30 sec - exiting 01:06:46 (1972): No heartbeat from core client for 30 sec - exiting 01:06:47 (1972): No heartbeat from core client for 30 sec - exiting 01:06:48 (1972): No heartbeat from core client for 30 sec - exiting 01:06:49 (1972): No heartbeat from core client for 30 sec - exiting 01:06:50 (1972): No heartbeat from core client for 30 sec - exiting 01:06:51 (1972): No heartbeat from core client for 30 sec - exiting 01:06:52 (1972): No heartbeat from core client for 30 sec - exiting 01:04:19 (4528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:04:21 (4528): No heartbeat from core client for 30 sec - exiting 01:04:22 (4528): No heartbeat from core client for 30 sec - exiting 01:04:23 (4528): No heartbeat from core client for 30 sec - exiting 01:04:24 (4528): No heartbeat from core client for 30 sec - exiting 01:04:25 (4528): No heartbeat from core client for 30 sec - exiting 01:04:26 (4528): No heartbeat from core client for 30 sec - exiting 01:04:27 (4528): No heartbeat from core client for 30 sec - exiting 01:04:28 (4528): No heartbeat from core client for 30 sec - exiting 01:04:29 (4528): No heartbeat from core client for 30 sec - exiting 01:04:30 (4528): No heartbeat from core client for 30 sec - exiting Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=948, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5320, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5320, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5320, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5320, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5320, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
18 May 2014 20:09:18	1325094	16585430	hadcm3n_88nt_1980_40_008720644_0	622,080	669,473	1.0762
18 May 2014 11:57:24	1325094	16585430	hadcm3n_88nt_1980_40_008720644_0	596,160	641,673	1.0763
18 May 2014 03:58:28	1325094	16585430	hadcm3n_88nt_1980_40_008720644_0	570,240	613,963	1.0767
17 May 2014 20:01:06	1325094	16585430	hadcm3n_88nt_1980_40_008720644_0	544,320	586,209	1.0770
17 May 2014 11:54:44	1325094	16585430	hadcm3n_88nt_1980_40_008720644_0	518,400	558,229	1.0768
17 May 2014 03:50:26	1325094	16585430	hadcm3n_88nt_1980_40_008720644_0	492,480	530,168	1.0765
16 May 2014 19:54:19	1325094	16585430	hadcm3n_88nt_1980_40_008720644_0	466,560	502,166	1.0763
16 May 2014 11:47:41	1325094	16585430	hadcm3n_88nt_1980_40_008720644_0	440,640	474,347	1.0765
16 May 2014 03:49:06	1325094	16585430	hadcm3n_88nt_1980_40_008720644_0	414,720	446,430	1.0765
15 May 2014 19:36:40	1325094	16585430	hadcm3n_88nt_1980_40_008720644_0	388,800	418,223	1.0757
15 May 2014 11:30:46	1325094	16585430	hadcm3n_88nt_1980_40_008720644_0	362,880	390,456	1.0760
15 May 2014 03:32:27	1325094	16585430	hadcm3n_88nt_1980_40_008720644_0	336,960	362,647	1.0762
14 May 2014 19:36:10	1325094	16585430	hadcm3n_88nt_1980_40_008720644_0	311,040	334,849	1.0765
09 May 2014 12:24:07	1325094	16585430	hadcm3n_88nt_1980_40_008720644_0	285,120	306,993	1.0767
09 May 2014 04:45:00	1325094	16585430	hadcm3n_88nt_1980_40_008720644_0	259,200	279,212	1.0772
08 May 2014 20:22:54	1325094	16585430	hadcm3n_88nt_1980_40_008720644_0	233,280	251,223	1.0769
08 May 2014 12:09:33	1325094	16585430	hadcm3n_88nt_1980_40_008720644_0	207,360	223,312	1.0769
08 May 2014 04:30:51	1325094	16585430	hadcm3n_88nt_1980_40_008720644_0	181,440	195,449	1.0772
07 May 2014 20:03:54	1325094	16585430	hadcm3n_88nt_1980_40_008720644_0	155,520	167,686	1.0782
07 May 2014 11:39:23	1325094	16585430	hadcm3n_88nt_1980_40_008720644_0	129,600	139,749	1.0783