Task 16080750

Name	hadcm3n_o6ho_2020_40_008402943_4
Workunit	8553799
Created	14 Nov 2013, 14:22:31 UTC
Sent	14 Nov 2013, 14:22:40 UTC
Report deadline	13 Feb 2014, 21:49:51 UTC
Received	27 Nov 2013, 3:29:18 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1278777
Run time	5 days 15 hours 50 min 6 sec
CPU time	4 days 15 hours 10 min 24 sec
Validate state	Invalid
Credit	4,043.52
Device peak FLOPS	3.22 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.31</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:54:58 (6992): No heartbeat from core client for 30 sec - exiting 08:55:00 (6992): No heartbeat from core client for 30 sec - exiting 08:55:01 (6992): No heartbeat from core client for 30 sec - exiting 08:55:02 (6992): No heartbeat from core client for 30 sec - exiting 08:55:03 (6992): No heartbeat from core client for 30 sec - exiting 08:55:04 (6992): No heartbeat from core client for 30 sec - exiting 08:55:05 (6992): No heartbeat from core client for 30 sec - exiting 08:55:06 (6992): No heartbeat from core client for 30 sec - exiting 08:55:07 (6992): No heartbeat from core client for 30 sec - exiting 08:55:08 (6992): No heartbeat from core client for 30 sec - exiting 08:55:09 (6992): No heartbeat from core client for 30 sec - exiting 08:55:10 (6992): No heartbeat from core client for 30 sec - exiting 08:55:11 (6992): No heartbeat from core client for 30 sec - exiting 08:55:12 (6992): No heartbeat from core client for 30 sec - exiting 08:55:13 (6992): No heartbeat from core client for 30 sec - exiting 08:55:14 (6992): No heartbeat from core client for 30 sec - exiting 08:55:15 (6992): No heartbeat from core client for 30 sec - exiting 08:55:16 (6992): No heartbeat from core client for 30 sec - exiting 08:55:17 (6992): No heartbeat from core client for 30 sec - exiting 08:55:18 (6992): No heartbeat from core client for 30 sec - exiting 08:55:19 (6992): No heartbeat from core client for 30 sec - exiting 08:55:20 (6992): No heartbeat from core client for 30 sec - exiting 08:55:21 (6992): No heartbeat from core client for 30 sec - exiting 08:55:22 (6992): No heartbeat from core client for 30 sec - exiting 08:55:23 (6992): No heartbeat from core client for 30 sec - exiting 08:55:24 (6992): No heartbeat from core client for 30 sec - exiting 08:55:25 (6992): No heartbeat from core client for 30 sec - exiting 08:55:26 (6992): No heartbeat from core client for 30 sec - exiting 08:55:27 (6992): No heartbeat from core client for 30 sec - exiting 08:55:28 (6992): No heartbeat from core client for 30 sec - exiting 08:55:29 (6992): No heartbeat from core client for 30 sec - exiting 08:55:30 (6992): No heartbeat from core client for 30 sec - exiting 08:55:31 (6992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:55:32 (6992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 14:04:25 (316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:08:44 (6756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4700, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:27:03 (7736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:56:12 (7812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 21:04:35 (6192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:15:51 (7356): No heartbeat from core client for 30 sec - exiting 12:15:52 (7356): No heartbeat from core client for 30 sec - exiting 12:15:53 (7356): No heartbeat from core client for 30 sec - exiting 12:15:54 (7356): No heartbeat from core client for 30 sec - exiting 12:15:55 (7356): No heartbeat from core client for 30 sec - exiting 12:15:56 (7356): No heartbeat from core client for 30 sec - exiting 12:15:57 (7356): No heartbeat from core client for 30 sec - exiting 12:15:58 (7356): No heartbeat from core client for 30 sec - exiting 12:15:59 (7356): No heartbeat from core client for 30 sec - exiting 12:16:00 (7356): No heartbeat from core client for 30 sec - exiting 12:16:01 (7356): No heartbeat from core client for 30 sec - exiting 12:16:02 (7356): No heartbeat from core client for 30 sec - exiting 12:16:03 (7356): No heartbeat from core client for 30 sec - exiting 12:16:04 (7356): No heartbeat from core client for 30 sec - exiting 12:16:05 (7356): No heartbeat from core client for 30 sec - exiting 12:16:06 (7356): No heartbeat from core client for 30 sec - exiting 12:16:07 (7356): No heartbeat from core client for 30 sec - exiting 12:16:08 (7356): No heartbeat from core client for 30 sec - exiting 12:16:09 (7356): No heartbeat from core client for 30 sec - exiting 12:16:10 (7356): No heartbeat from core client for 30 sec - exiting 12:16:11 (7356): No heartbeat from core client for 30 sec - exiting 12:16:12 (7356): No heartbeat from core client for 30 sec - exiting 12:16:13 (7356): No heartbeat from core client for 30 sec - exiting 12:16:14 (7356): No heartbeat from core client for 30 sec - exiting 12:16:15 (7356): No heartbeat from core client for 30 sec - exiting 12:16:16 (7356): No heartbeat from core client for 30 sec - exiting 12:16:17 (7356): No heartbeat from core client for 30 sec - exiting 12:16:18 (7356): No heartbeat from core client for 30 sec - exiting 12:16:19 (7356): No heartbeat from core client for 30 sec - exiting 12:16:20 (7356): No heartbeat from core client for 30 sec - exiting 12:16:21 (7356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:04:55 (4316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7476, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7476, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7476, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7476, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7476, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7476, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Nov 2013 23:48:01	1278777	16080750	hadcm3n_o6ho_2020_40_008402943_4	336,960	386,990	1.1485
24 Nov 2013 21:40:30	1278777	16080750	hadcm3n_o6ho_2020_40_008402943_4	311,040	356,191	1.1452
22 Nov 2013 19:31:51	1278777	16080750	hadcm3n_o6ho_2020_40_008402943_4	285,120	326,048	1.1435
22 Nov 2013 10:10:11	1278777	16080750	hadcm3n_o6ho_2020_40_008402943_4	259,200	296,606	1.1443
21 Nov 2013 21:57:01	1278777	16080750	hadcm3n_o6ho_2020_40_008402943_4	233,280	266,935	1.1443
21 Nov 2013 04:02:05	1278777	16080750	hadcm3n_o6ho_2020_40_008402943_4	207,360	236,707	1.1415
20 Nov 2013 16:17:18	1278777	16080750	hadcm3n_o6ho_2020_40_008402943_4	181,440	206,699	1.1392
20 Nov 2013 03:20:13	1278777	16080750	hadcm3n_o6ho_2020_40_008402943_4	155,520	176,973	1.1379
19 Nov 2013 15:29:37	1278777	16080750	hadcm3n_o6ho_2020_40_008402943_4	129,600	147,758	1.1401
18 Nov 2013 18:45:51	1278777	16080750	hadcm3n_o6ho_2020_40_008402943_4	103,680	118,268	1.1407
17 Nov 2013 08:58:22	1278777	16080750	hadcm3n_o6ho_2020_40_008402943_4	77,760	87,907	1.1305
15 Nov 2013 19:26:55	1278777	16080750	hadcm3n_o6ho_2020_40_008402943_4	51,840	58,719	1.1327
15 Nov 2013 04:35:01	1278777	16080750	hadcm3n_o6ho_2020_40_008402943_4	25,920	30,116	1.1619