Task 14370290

Name	hadcm3n_yfoo_1980_40_007858867_2
Workunit	8013979
Created	6 Apr 2012, 11:00:05 UTC
Sent	6 Apr 2012, 11:00:21 UTC
Report deadline	6 Jul 2012, 18:27:32 UTC
Received	2 May 2012, 8:04:54 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	462346
Run time	10 days 12 hours 36 min 3 sec
CPU time	9 days 20 hours 5 min 41 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.03 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.25</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:31:25 (4908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:10:59 (3100): No heartbeat from core client for 30 sec - exiting 03:11:00 (3100): No heartbeat from core client for 30 sec - exiting 03:11:01 (3100): No heartbeat from core client for 30 sec - exiting 03:11:03 (3100): No heartbeat from core client for 30 sec - exiting 03:11:04 (3100): No heartbeat from core client for 30 sec - exiting 03:11:05 (3100): No heartbeat from core client for 30 sec - exiting 03:11:06 (3100): No heartbeat from core client for 30 sec - exiting 03:11:07 (3100): No heartbeat from core client for 30 sec - exiting 03:11:08 (3100): No heartbeat from core client for 30 sec - exiting 03:11:09 (3100): No heartbeat from core client for 30 sec - exiting 03:11:10 (3100): No heartbeat from core client for 30 sec - exiting 03:11:11 (3100): No heartbeat from core client for 30 sec - exiting 03:11:12 (3100): No heartbeat from core client for 30 sec - exiting 03:11:13 (3100): No heartbeat from core client for 30 sec - exiting 03:11:15 (3100): No heartbeat from core client for 30 sec - exiting 03:11:16 (3100): No heartbeat from core client for 30 sec - exiting 03:11:17 (3100): No heartbeat from core client for 30 sec - exiting 03:11:18 (3100): No heartbeat from core client for 30 sec - exiting 03:11:19 (3100): No heartbeat from core client for 30 sec - exiting 03:11:20 (3100): No heartbeat from core client for 30 sec - exiting 03:11:21 (3100): No heartbeat from core client for 30 sec - exiting 03:11:22 (3100): No heartbeat from core client for 30 sec - exiting 03:11:23 (3100): No heartbeat from core client for 30 sec - exiting 03:11:24 (3100): No heartbeat from core client for 30 sec - exiting 03:11:25 (3100): No heartbeat from core client for 30 sec - exiting 03:11:27 (3100): No heartbeat from core client for 30 sec - exiting 03:11:28 (3100): No heartbeat from core client for 30 sec - exiting 03:11:29 (3100): No heartbeat from core client for 30 sec - exiting 03:11:30 (3100): No heartbeat from core client for 30 sec - exiting 03:11:31 (3100): No heartbeat from core client for 30 sec - exiting 03:11:32 (3100): No heartbeat from core client for 30 sec - exiting 03:11:33 (3100): No heartbeat from core client for 30 sec - exiting 03:11:34 (3100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:11:35 (3100): No heartbeat from core client for 30 sec - exiting 03:11:36 (3100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:46:42 (4380): No heartbeat from core client for 30 sec - exiting 20:46:43 (4380): No heartbeat from core client for 30 sec - exiting 20:46:44 (4380): No heartbeat from core client for 30 sec - exiting 20:46:45 (4380): No heartbeat from core client for 30 sec - exiting 20:46:46 (4380): No heartbeat from core client for 30 sec - exiting 20:46:47 (4380): No heartbeat from core client for 30 sec - exiting 20:46:48 (4380): No heartbeat from core client for 30 sec - exiting 20:46:49 (4380): No heartbeat from core client for 30 sec - exiting 20:46:51 (4380): No heartbeat from core client for 30 sec - exiting 20:46:52 (4380): No heartbeat from core client for 30 sec - exiting 20:46:53 (4380): No heartbeat from core client for 30 sec - exiting 20:46:54 (4380): No heartbeat from core client for 30 sec - exiting 20:46:55 (4380): No heartbeat from core client for 30 sec - exiting 20:46:56 (4380): No heartbeat from core client for 30 sec - exiting 20:46:57 (4380): No heartbeat from core client for 30 sec - exiting 20:46:58 (4380): No heartbeat from core client for 30 sec - exiting 20:46:59 (4380): No heartbeat from core client for 30 sec - exiting 20:47:00 (4380): No heartbeat from core client for 30 sec - exiting 20:47:01 (4380): No heartbeat from core client for 30 sec - exiting 20:47:03 (4380): No heartbeat from core client for 30 sec - exiting 20:47:04 (4380): No heartbeat from core client for 30 sec - exiting 20:47:05 (4380): No heartbeat from core client for 30 sec - exiting 20:47:06 (4380): No heartbeat from core client for 30 sec - exiting 20:47:07 (4380): No heartbeat from core client for 30 sec - exiting 20:47:08 (4380): No heartbeat from core client for 30 sec - exiting 20:47:09 (4380): No heartbeat from core client for 30 sec - exiting 20:47:10 (4380): No heartbeat from core client for 30 sec - exiting 20:47:11 (4380): No heartbeat from core client for 30 sec - exiting 20:47:12 (4380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:47:13 (4380): No heartbeat from core client for 30 sec - exiting 20:47:15 (4380): No heartbeat from core client for 30 sec - exiting 20:47:16 (4380): No heartbeat from core client for 30 sec - exiting 20:47:17 (4380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:37:12 (4868): No heartbeat from core client for 30 sec - exiting 08:37:13 (4868): No heartbeat from core client for 30 sec - exiting 08:37:14 (4868): No heartbeat from core client for 30 sec - exiting 08:37:15 (4868): No heartbeat from core client for 30 sec - exiting 08:37:16 (4868): No heartbeat from core client for 30 sec - exiting 08:37:18 (4868): No heartbeat from core client for 30 sec - exiting 08:37:19 (4868): No heartbeat from core client for 30 sec - exiting 08:37:20 (4868): No heartbeat from core client for 30 sec - exiting 08:37:21 (4868): No heartbeat from core client for 30 sec - exiting 08:37:22 (4868): No heartbeat from core client for 30 sec - exiting 08:37:23 (4868): No heartbeat from core client for 30 sec - exiting 08:37:24 (4868): No heartbeat from core client for 30 sec - exiting 08:37:25 (4868): No heartbeat from core client for 30 sec - exiting 08:37:26 (4868): No heartbeat from core client for 30 sec - exiting 08:37:27 (4868): No heartbeat from core client for 30 sec - exiting 08:37:29 (4868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:37:30 (4868): No heartbeat from core client for 30 sec - exiting 08:37:31 (4868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:37:20 (4604): No heartbeat from core client for 30 sec - exiting 08:37:21 (4604): No heartbeat from core client for 30 sec - exiting 08:37:22 (4604): No heartbeat from core client for 30 sec - exiting 08:37:23 (4604): No heartbeat from core client for 30 sec - exiting 08:37:24 (4604): No heartbeat from core client for 30 sec - exiting 08:37:25 (4604): No heartbeat from core client for 30 sec - exiting 08:37:26 (4604): No heartbeat from core client for 30 sec - exiting 08:37:28 (4604): No heartbeat from core client for 30 sec - exiting 08:37:29 (4604): No heartbeat from core client for 30 sec - exiting 08:37:30 (4604): No heartbeat from core client for 30 sec - exiting 08:37:31 (4604): No heartbeat from core client for 30 sec - exiting 08:37:32 (4604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:37:33 (4604): No heartbeat from core client for 30 sec - exiting 08:37:34 (4604): No heartbeat from core client for 30 sec - exiting 08:37:35 (4604): No heartbeat from core client for 30 sec - exiting 08:37:36 (4604): No heartbeat from core client for 30 sec - exiting 08:37:37 (4604): No heartbeat from core client for 30 sec - exiting 08:37:39 (4604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:36:39 (3044): No heartbeat from core client for 30 sec - exiting 08:36:40 (3044): No heartbeat from core client for 30 sec - exiting 08:36:41 (3044): No heartbeat from core client for 30 sec - exiting 08:36:42 (3044): No heartbeat from core client for 30 sec - exiting 08:36:43 (3044): No heartbeat from core client for 30 sec - exiting 08:36:44 (3044): No heartbeat from core client for 30 sec - exiting 08:36:46 (3044): No heartbeat from core client for 30 sec - exiting 08:36:47 (3044): No heartbeat from core client for 30 sec - exiting 08:36:48 (3044): No heartbeat from core client for 30 sec - exiting 08:36:49 (3044): No heartbeat from core client for 30 sec - exiting 08:36:50 (3044): No heartbeat from core client for 30 sec - exiting 08:36:51 (3044): No heartbeat from core client for 30 sec - exiting 08:36:52 (3044): No heartbeat from core client for 30 sec - exiting 08:36:53 (3044): No heartbeat from core client for 30 sec - exiting 08:36:54 (3044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:21:53 (4220): No heartbeat from core client for 30 sec - exiting 20:21:54 (4220): No heartbeat from core client for 30 sec - exiting 20:21:55 (4220): No heartbeat from core client for 30 sec - exiting 20:21:57 (4220): No heartbeat from core client for 30 sec - exiting 20:21:58 (4220): No heartbeat from core client for 30 sec - exiting 20:21:59 (4220): No heartbeat from core client for 30 sec - exiting 20:22:00 (4220): No heartbeat from core client for 30 sec - exiting 20:22:01 (4220): No heartbeat from core client for 30 sec - exiting 20:22:02 (4220): No heartbeat from core client for 30 sec - exiting 20:22:03 (4220): No heartbeat from core client for 30 sec - exiting 20:22:04 (4220): No heartbeat from core client for 30 sec - exiting 20:22:05 (4220): No heartbeat from core client for 30 sec - exiting 20:22:06 (4220): No heartbeat from core client for 30 sec - exiting 20:22:07 (4220): No heartbeat from core client for 30 sec - exiting 20:22:09 (4220): No heartbeat from core client for 30 sec - exiting 20:22:10 (4220): No heartbeat from core client for 30 sec - exiting 20:22:11 (4220): No heartbeat from core client for 30 sec - exiting 20:22:12 (4220): No heartbeat from core client for 30 sec - exiting 20:22:13 (4220): No heartbeat from core client for 30 sec - exiting 20:22:14 (4220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:22:15 (4220): No heartbeat from core client for 30 sec - exiting 20:22:16 (4220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3484, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3484, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3484, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5080, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5080, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 01:25:51 (4356): No heartbeat from core client for 30 sec - exiting 01:25:52 (4356): No heartbeat from core client for 30 sec - exiting 01:25:53 (4356): No heartbeat from core client for 30 sec - exiting 01:25:54 (4356): No heartbeat from core client for 30 sec - exiting 01:25:55 (4356): No heartbeat from core client for 30 sec - exiting 01:25:57 (4356): No heartbeat from core client for 30 sec - exiting 01:25:58 (4356): No heartbeat from core client for 30 sec - exiting 01:25:59 (4356): No heartbeat from core client for 30 sec - exiting 01:26:00 (4356): No heartbeat from core client for 30 sec - exiting 01:26:01 (4356): No heartbeat from core client for 30 sec - exiting 01:26:02 (4356): No heartbeat from core client for 30 sec - exiting 01:26:03 (4356): No heartbeat from core client for 30 sec - exiting 01:26:04 (4356): No heartbeat from core client for 30 sec - exiting 01:26:05 (4356): No heartbeat from core client for 30 sec - exiting 01:26:06 (4356): No heartbeat from core client for 30 sec - exiting 01:26:07 (4356): No heartbeat from core client for 30 sec - exiting 01:26:09 (4356): No heartbeat from core client for 30 sec - exiting 01:26:10 (4356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:26:11 (4356): No heartbeat from core client for 30 sec - exiting 01:26:12 (4356): No heartbeat from core client for 30 sec - exiting 01:26:13 (4356): No heartbeat from core client for 30 sec - exiting 01:26:14 (4356): No heartbeat from core client for 30 sec - exiting 01:26:15 (4356): No heartbeat from core client for 30 sec - exiting 01:26:16 (4356): No heartbeat from core client for 30 sec - exiting Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4848, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 Apr 2012 01:47:49	462346	14370290	hadcm3n_yfoo_1980_40_007858867_2	259,200	806,291	3.1107
27 Apr 2012 19:48:51	462346	14370290	hadcm3n_yfoo_1980_40_007858867_2	233,280	726,492	3.1142
24 Apr 2012 15:50:10	462346	14370290	hadcm3n_yfoo_1980_40_007858867_2	207,360	643,093	3.1013
18 Apr 2012 14:45:42	462346	14370290	hadcm3n_yfoo_1980_40_007858867_2	181,440	557,180	3.0709
13 Apr 2012 12:56:22	462346	14370290	hadcm3n_yfoo_1980_40_007858867_2	155,520	472,810	3.0402
11 Apr 2012 12:33:06	462346	14370290	hadcm3n_yfoo_1980_40_007858867_2	129,600	390,454	3.0128
10 Apr 2012 04:11:10	462346	14370290	hadcm3n_yfoo_1980_40_007858867_2	103,680	311,262	3.0021
09 Apr 2012 06:01:18	462346	14370290	hadcm3n_yfoo_1980_40_007858867_2	77,760	234,716	3.0185
08 Apr 2012 07:52:44	462346	14370290	hadcm3n_yfoo_1980_40_007858867_2	51,840	157,271	3.0338
07 Apr 2012 09:27:43	462346	14370290	hadcm3n_yfoo_1980_40_007858867_2	25,920	78,183	3.0163