Task 16142915

Name	hadcm3n_7yhr_1980_40_008455986_1
Workunit	8606842
Created	13 Dec 2013, 2:53:30 UTC
Sent	13 Dec 2013, 2:53:36 UTC
Report deadline	14 Mar 2014, 10:20:47 UTC
Received	1 Jan 2014, 22:11:21 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1027385
Run time	2 days 18 hours 7 min 3 sec
CPU time	2 days 17 hours 47 min 23 sec
Validate state	Invalid
Credit	1,866.24
Device peak FLOPS	2.56 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.33</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... 05:16:18 (3696): No heartbeat from core client for 30 sec - exiting 05:16:19 (3696): No heartbeat from core client for 30 sec - exiting 05:16:20 (3696): No heartbeat from core client for 30 sec - exiting 05:16:21 (3696): No heartbeat from core client for 30 sec - exiting 05:16:23 (3696): No heartbeat from core client for 30 sec - exiting 05:16:24 (3696): No heartbeat from core client for 30 sec - exiting 05:16:25 (3696): No heartbeat from core client for 30 sec - exiting 05:16:26 (3696): No heartbeat from core client for 30 sec - exiting 05:16:27 (3696): No heartbeat from core client for 30 sec - exiting 05:16:28 (3696): No heartbeat from core client for 30 sec - exiting 05:16:29 (3696): No heartbeat from core client for 30 sec - exiting 05:16:30 (3696): No heartbeat from core client for 30 sec - exiting 05:16:31 (3696): No heartbeat from core client for 30 sec - exiting 05:16:32 (3696): No heartbeat from core client for 30 sec - exiting 05:16:33 (3696): No heartbeat from core client for 30 sec - exiting 05:16:35 (3696): No heartbeat from core client for 30 sec - exiting 05:16:36 (3696): No heartbeat from core client for 30 sec - exiting 05:16:37 (3696): No heartbeat from core client for 30 sec - exiting 05:16:38 (3696): No heartbeat from core client for 30 sec - exiting 05:16:39 (3696): No heartbeat from core client for 30 sec - exiting 05:16:40 (3696): No heartbeat from core client for 30 sec - exiting 05:16:41 (3696): No heartbeat from core client for 30 sec - exiting 05:16:42 (3696): No heartbeat from core client for 30 sec - exiting 05:16:43 (3696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:53:39 (848): No heartbeat from core client for 30 sec - exiting 05:53:40 (848): No heartbeat from core client for 30 sec - exiting 05:53:41 (848): No heartbeat from core client for 30 sec - exiting 05:53:42 (848): No heartbeat from core client for 30 sec - exiting 05:53:44 (848): No heartbeat from core client for 30 sec - exiting 05:53:45 (848): No heartbeat from core client for 30 sec - exiting 05:53:46 (848): No heartbeat from core client for 30 sec - exiting 05:53:47 (848): No heartbeat from core client for 30 sec - exiting 05:53:48 (848): No heartbeat from core client for 30 sec - exiting 05:53:49 (848): No heartbeat from core client for 30 sec - exiting 05:53:50 (848): No heartbeat from core client for 30 sec - exiting 05:53:51 (848): No heartbeat from core client for 30 sec - exiting 05:53:52 (848): No heartbeat from core client for 30 sec - exiting 05:53:53 (848): No heartbeat from core client for 30 sec - exiting 05:53:54 (848): No heartbeat from core client for 30 sec - exiting 05:53:56 (848): No heartbeat from core client for 30 sec - exiting 05:53:57 (848): No heartbeat from core client for 30 sec - exiting 05:53:58 (848): No heartbeat from core client for 30 sec - exiting 05:53:59 (848): No heartbeat from core client for 30 sec - exiting 05:54:00 (848): No heartbeat from core client for 30 sec - exiting 05:54:01 (848): No heartbeat from core client for 30 sec - exiting 05:54:02 (848): No heartbeat from core client for 30 sec - exiting 05:54:03 (848): No heartbeat from core client for 30 sec - exiting 05:54:04 (848): No heartbeat from core client for 30 sec - exiting 05:54:05 (848): No heartbeat from core client for 30 sec - exiting 05:54:06 (848): No heartbeat from core client for 30 sec - exiting 05:54:08 (848): No heartbeat from core client for 30 sec - exiting 05:54:09 (848): No heartbeat from core client for 30 sec - exiting 05:54:10 (848): No heartbeat from core client for 30 sec - exiting 05:54:11 (848): No heartbeat from core client for 30 sec - exiting 05:54:12 (848): No heartbeat from core client for 30 sec - exiting 05:54:13 (848): No heartbeat from core client for 30 sec - exiting 05:54:14 (848): No heartbeat from core client for 30 sec - exiting 05:54:15 (848): No heartbeat from core client for 30 sec - exiting 05:54:16 (848): No heartbeat from core client for 30 sec - exiting 05:54:17 (848): No heartbeat from core client for 30 sec - exiting 05:54:19 (848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5544, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5544, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4092, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4092, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4092, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4124, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
28 Dec 2013 17:18:15	1027385	16142915	hadcm3n_7yhr_1980_40_008455986_1	155,520	211,910	1.3626
25 Dec 2013 20:45:48	1027385	16142915	hadcm3n_7yhr_1980_40_008455986_1	129,600	177,499	1.3696
23 Dec 2013 02:24:31	1027385	16142915	hadcm3n_7yhr_1980_40_008455986_1	103,680	142,935	1.3786
20 Dec 2013 15:12:03	1027385	16142915	hadcm3n_7yhr_1980_40_008455986_1	77,760	107,011	1.3762
18 Dec 2013 17:19:08	1027385	16142915	hadcm3n_7yhr_1980_40_008455986_1	51,840	71,471	1.3787
15 Dec 2013 23:36:11	1027385	16142915	hadcm3n_7yhr_1980_40_008455986_1	25,920	35,920	1.3858