Task 16074939

Name	hadcm3n_7yht_1980_40_008455988_4
Workunit	8606844
Created	28 Oct 2013, 5:45:21 UTC
Sent	28 Oct 2013, 5:45:28 UTC
Report deadline	27 Jan 2014, 13:12:39 UTC
Received	29 Oct 2013, 21:04:13 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1092868
Run time	1 days 12 hours 47 min 40 sec
CPU time	1 days 12 hours 14 min 37 sec
Validate state	Invalid
Credit	1,555.20
Device peak FLOPS	4.28 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.23</core_client_version> <![CDATA[ <message> Urządzenie nie rozpoznaje polecenia. (0x16) - exit code 22 (0x16) </message> <stderr_txt> 07:38:35 (3264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:41:55 (5000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:47:39 (1624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:20:32 (3424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:25:15 (3616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:19:32 (1284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:24:38 (2432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:37:10 (2968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:58:59 (4640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:43:56 (4788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:05:40 (4544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:58:42 (2996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:11:30 (4792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:20:21 (3924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:24:43 (4144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:38:38 (4524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:55:54 (4892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:00:26 (4496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:04:11 (5020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:04:55 (4736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:05:43 (1348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:06:55 (1660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:08:02 (4920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:08:09 (4920): No heartbeat from core client for 30 sec - exiting 16:08:40 (2296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:08:52 (2296): No heartbeat from core client for 30 sec - exiting 16:09:47 (5100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:10:02 (5100): No heartbeat from core client for 30 sec - exiting 16:10:03 (5100): No heartbeat from core client for 30 sec - exiting 16:10:04 (5100): No heartbeat from core client for 30 sec - exiting 16:10:05 (5100): No heartbeat from core client for 30 sec - exiting 16:10:47 (4408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:11:33 (2000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:11:58 (2000): No heartbeat from core client for 30 sec - exiting 16:11:59 (2000): No heartbeat from core client for 30 sec - exiting 16:12:00 (2000): No heartbeat from core client for 30 sec - exiting 16:12:48 (4244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:13:09 (4244): No heartbeat from core client for 30 sec - exiting 16:13:48 (2832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:13:50 (2832): No heartbeat from core client for 30 sec - exiting 16:13:51 (2832): No heartbeat from core client for 30 sec - exiting 16:13:52 (2832): No heartbeat from core client for 30 sec - exiting 16:13:53 (2832): No heartbeat from core client for 30 sec - exiting 16:13:54 (2832): No heartbeat from core client for 30 sec - exiting 16:13:55 (2832): No heartbeat from core client for 30 sec - exiting 16:13:56 (2832): No heartbeat from core client for 30 sec - exiting 16:13:57 (2832): No heartbeat from core client for 30 sec - exiting 16:14:31 (2204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:14:42 (2204): No heartbeat from core client for 30 sec - exiting 16:14:43 (2204): No heartbeat from core client for 30 sec - exiting 16:14:44 (2204): No heartbeat from core client for 30 sec - exiting 16:14:45 (2204): No heartbeat from core client for 30 sec - exiting 16:15:26 (4900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:56:05 (1448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:57:31 (3772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:58:12 (4588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:58:28 (4588): No heartbeat from core client for 30 sec - exiting 19:58:29 (4588): No heartbeat from core client for 30 sec - exiting 19:58:30 (4588): No heartbeat from core client for 30 sec - exiting 19:59:09 (4972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:59:33 (4972): No heartbeat from core client for 30 sec - exiting 19:59:36 (4972): No heartbeat from core client for 30 sec - exiting 20:00:18 (3256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:01:19 (2972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:01:39 (2972): No heartbeat from core client for 30 sec - exiting 20:02:21 (4384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:03:13 (5064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:04:01 (1824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:04:22 (1824): No heartbeat from core client for 30 sec - exiting 20:05:07 (1924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:05:37 (1924): No heartbeat from core client for 30 sec - exiting 20:05:38 (1924): No heartbeat from core client for 30 sec - exiting 20:05:39 (1924): No heartbeat from core client for 30 sec - exiting 20:05:40 (1924): No heartbeat from core client for 30 sec - exiting 20:05:41 (1924): No heartbeat from core client for 30 sec - exiting 20:05:42 (1924): No heartbeat from core client for 30 sec - exiting 20:05:43 (1924): No heartbeat from core client for 30 sec - exiting 20:06:37 (5112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:06:56 (5112): No heartbeat from core client for 30 sec - exiting 20:07:39 (1900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:08:43 (3368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:10:25 (3972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:10:39 (3972): No heartbeat from core client for 30 sec - exiting 20:10:40 (3972): No heartbeat from core client for 30 sec - exiting 20:10:41 (3972): No heartbeat from core client for 30 sec - exiting 20:10:42 (3972): No heartbeat from core client for 30 sec - exiting 20:10:43 (3972): No heartbeat from core client for 30 sec - exiting 20:10:44 (3972): No heartbeat from core client for 30 sec - exiting 20:10:45 (3972): No heartbeat from core client for 30 sec - exiting 20:10:46 (3972): No heartbeat from core client for 30 sec - exiting 20:10:47 (3972): No heartbeat from core client for 30 sec - exiting 20:10:48 (3972): No heartbeat from core client for 30 sec - exiting 20:11:25 (3060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:12:05 (5044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:12:58 (4440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:14:17 (1900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:15:17 (1144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:15:49 (1144): No heartbeat from core client for 30 sec - exiting 20:16:41 (3936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:17:39 (4144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:18:05 (4144): No heartbeat from core client for 30 sec - exiting 20:18:56 (4340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:20:32 (4408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:21:55 (4104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:23:30 (1816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:24:27 (3980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:25:37 (5084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:27:10 (3016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:28:21 (4856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:29:29 (1728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:31:20 (1148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:32:20 (4932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:33:45 (3588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:34:47 (2204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:35:12 (2204): No heartbeat from core client for 30 sec - exiting 20:36:11 (3704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:37:11 (4848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:38:08 (2672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:39:19 (2920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:40:36 (4692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:41:45 (4184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:42:55 (2580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4816, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4816, iMonCtr=1 Model crash detected, will try to restart... 20:43:50 (4816): No heartbeat from core client for 30 sec - exiting 20:43:51 (4816): No heartbeat from core client for 30 sec - exiting 20:43:52 (4816): No heartbeat from core client for 30 sec - exiting 20:43:53 (4816): No heartbeat from core client for 30 sec - exiting 20:44:20 (4816): No heartbeat from core client for 30 sec - exiting 20:44:21 (4816): No heartbeat from core client for 30 sec - exiting 20:44:22 (4816): No heartbeat from core client for 30 sec - exiting 20:44:23 (4816): No heartbeat from core client for 30 sec - exiting 20:44:24 (4816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:44:25 (4816): No heartbeat from core client for 30 sec - exiting 20:44:26 (4816): No heartbeat from core client for 30 sec - exiting 20:44:27 (4816): No heartbeat from core client for 30 sec - exiting S20:45:04 (4736):i No heartbeat from core client for 30 sec - exiting nal 22 received, exiting... Called boinc_finish CPDN Monitor - No 'heartbeat' from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4972, iMonCtr=1 Model crash detected, will try to restart... 20:46:15 (4972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... S20:46:49 (4160): No heartbeat from core client for 30 sec - exiting ignal 22 received, exiting... Called boinc_finish CPDN Monitor - No 'heartbeat' from BOINC... S20:47:31 (5104):ignal 22 receivedNo heartbeat from core client for 30 sec - exiting , exiting... Called boinc_finish CPDN Monitor - No 'heartbeat' from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3876, iMonCtr=1 Model crash detected, will try to restart... 20:48:26 (3876): No heartbeat from core client for 30 sec - exiting 20:48:27 (3876): No heartbeat from core client for 30 sec - exiting 20:48:28 (3876): No heartbeat from core client for 30 sec - exiting 20:48:29 (3876): No heartbeat from core client for 30 sec - exiting 20:48:30 (3876): No heartbeat from core client for 30 sec - exiting 20:48:31 (3876): No heartbeat from core client for 30 sec - exiting 20:48:32 (3876): No heartbeat from core client for 30 sec - exiting 20:48:33 (3876): No heartbeat from core client for 30 sec - exiting 20:48:34 (3876): No heartbeat from core client for 30 sec - exiting 20:48:35 (3876): No heartbeat from core client for 30 sec - exiting 20:48:36 (3876): No heartbeat from core client for 30 sec - exiting 20:48:37 (3876): No heartbeat from core client for 30 sec - exiting 20:48:38 (3876): No heartbeat from core client for 30 sec - exiting 20:48:39 (3876): No heartbeat from core client for 30 sec - exiting 20:48:40 (3876): No heartbeat from core client for 30 sec - exiting 20:48:41 (3876): No heartbeat from core client for 30 sec - exiting 20:48:42 (3876): No heartbeat from core client for 30 sec - exiting 20:48:43 (3876): No heartbeat from core client for 30 sec - exiting 20:48:44 (3876): No heartbeat from core client for 30 sec - exiting 20:48:45 (3876): No heartbeat from core client for 30 sec - exiting 20:48:46 (3876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... S20:49:37 (4160):ignal 22 received, exiting... Called boinc_finish No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2324, iMonCtr=1 Model crash detected, will try to restart... 20:51:31 (2324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... S20:52:27 (3816):i No heartbeat from core client for 30 sec - exiting nal 22 received, exiting... Called boinc_finish CPDN Monitor - No 'heartbeat' from BOINC... S20:53:34 (4392): No heartbeat from core client for 30 sec - exiting gnal 22 received, exiting... Called boinc_finish CPDN Monitor - No 'heartbeat' from BOINC... 20:54:12 (4392): No heartbeat from core client for 30 sec - exiting S20:55:01 (4692):i No heartbeat from core client for 30 sec - exiting gnal 22 received, exiting... Called boinc_finish CPDN Monitor - No 'heartbeat' from BOINC... S20:56:10 (2360): No heartbeat from core client for 30 sec - exiting ignal 22 received, exiting... Called boinc_finish CPDN Monitor - No 'heartbeat' from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1588, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish 20:58:46 (1588): No heartbeat from core client for 30 sec - exiting 20:58:47 (1588): No heartbeat from core client for 30 sec - exiting 21:00:37 (4596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:01:36 (1564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 30 - Return code = 16 Model crashed: READHEAD: I/O error tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 30 - Return code = 16 Model crashed: READHEAD: I/O error tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 30 - Return code = 16 Model crashed: READHEAD: I/O error tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 30 - Return code = 16 Model crashed: READHEAD: I/O error tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 30 - Return code = 16 Model crashed: READHEAD: I/O error tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 30 - Return code = 16 Model crashed: READHEAD: I/O error tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 Oct 2013 17:25:50	1092868	16074939	hadcm3n_7yht_1980_40_008455988_4	129,600	118,987	0.9181
29 Oct 2013 08:57:58	1092868	16074939	hadcm3n_7yht_1980_40_008455988_4	103,680	95,806	0.9241
29 Oct 2013 02:45:18	1092868	16074939	hadcm3n_7yht_1980_40_008455988_4	77,760	72,078	0.9269
28 Oct 2013 19:25:48	1092868	16074939	hadcm3n_7yht_1980_40_008455988_4	51,840	48,173	0.9293
28 Oct 2013 12:38:59	1092868	16074939	hadcm3n_7yht_1980_40_008455988_4	25,920	24,016	0.9265