Task 15598982

Name	hadcm3n_47ux_1940_40_008311378_0
Workunit	8462513
Created	8 Feb 2013, 4:16:53 UTC
Sent	8 Feb 2013, 20:54:32 UTC
Report deadline	11 May 2013, 4:21:43 UTC
Received	21 Mar 2013, 17:27:04 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1152504
Run time	5 days 8 hours 42 min 38 sec
CPU time	4 days 9 hours 37 min 3 sec
Validate state	Invalid
Credit	2,488.32
Device peak FLOPS	2.98 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> Il dispositivo non riconosce il comando. (0x16) - exit code 22 (0x16) </message> <stderr_txt> 09:29:43 (6012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7236, iMonCtr=1 Model crash detected, will try to restart... 18:58:41 (4368): No heartbeat from core client for 30 sec - exiting 18:58:42 (4368): No heartbeat from core client for 30 sec - exiting 18:58:43 (4368): No heartbeat from core client for 30 sec - exiting 18:58:44 (4368): No heartbeat from core client for 30 sec - exiting 18:58:45 (4368): No heartbeat from core client for 30 sec - exiting 18:58:46 (4368): No heartbeat from core client for 30 sec - exiting 18:58:47 (4368): No heartbeat from core client for 30 sec - exiting 18:58:48 (4368): No heartbeat from core client for 30 sec - exiting 18:58:49 (4368): No heartbeat from core client for 30 sec - exiting 18:58:50 (4368): No heartbeat from core client for 30 sec - exiting 18:58:51 (4368): No heartbeat from core client for 30 sec - exiting 18:58:52 (4368): No heartbeat from core client for 30 sec - exiting 18:58:53 (4368): No heartbeat from core client for 30 sec - exiting 18:58:54 (4368): No heartbeat from core client for 30 sec - exiting 18:58:55 (4368): No heartbeat from core client for 30 sec - exiting 18:58:56 (4368): No heartbeat from core client for 30 sec - exiting 18:58:57 (4368): No heartbeat from core client for 30 sec - exiting 18:58:58 (4368): No heartbeat from core client for 30 sec - exiting 18:58:59 (4368): No heartbeat from core client for 30 sec - exiting 18:59:00 (4368): No heartbeat from core client for 30 sec - exiting 18:59:01 (4368): No heartbeat from core client for 30 sec - exiting 18:59:02 (4368): No heartbeat from core client for 30 sec - exiting 18:59:03 (4368): No heartbeat from core client for 30 sec - exiting 18:59:04 (4368): No heartbeat from core client for 30 sec - exiting 18:59:05 (4368): No heartbeat from core client for 30 sec - exiting 18:59:06 (4368): No heartbeat from core client for 30 sec - exiting 18:59:07 (4368): No heartbeat from core client for 30 sec - exiting 18:59:08 (4368): No heartbeat from core client for 30 sec - exiting 18:59:09 (4368): No heartbeat from core client for 30 sec - exiting 18:59:10 (4368): No heartbeat from core client for 30 sec - exiting 18:59:11 (4368): No heartbeat from core client for 30 sec - exiting 18:59:12 (4368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:36:44 (4368): No heartbeat from core client for 30 sec - exiting 17:36:45 (4368): No heartbeat from core client for 30 sec - exiting 17:36:46 (4368): No heartbeat from core client for 30 sec - exiting 17:36:47 (4368): No heartbeat from core client for 30 sec - exiting 17:36:48 (4368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:45:58 (5028): No heartbeat from core client for 30 sec - exiting 20:45:59 (5028): No heartbeat from core client for 30 sec - exiting 20:46:00 (5028): No heartbeat from core client for 30 sec - exiting 20:46:01 (5028): No heartbeat from core client for 30 sec - exiting 20:46:02 (5028): No heartbeat from core client for 30 sec - exiting 20:46:03 (5028): No heartbeat from core client for 30 sec - exiting 20:46:04 (5028): No heartbeat from core client for 30 sec - exiting 20:46:05 (5028): No heartbeat from core client for 30 sec - exiting 20:46:06 (5028): No heartbeat from core client for 30 sec - exiting 20:46:07 (5028): No heartbeat from core client for 30 sec - exiting 20:46:08 (5028): No heartbeat from core client for 30 sec - exiting 20:46:09 (5028): No heartbeat from core client for 30 sec - exiting 20:46:10 (5028): No heartbeat from core client for 30 sec - exiting 20:46:11 (5028): No heartbeat from core client for 30 sec - exiting 20:46:12 (5028): No heartbeat from core client for 30 sec - exiting 20:46:13 (5028): No heartbeat from core client for 30 sec - exiting 20:46:14 (5028): No heartbeat from core client for 30 sec - exiting 20:46:15 (5028): No heartbeat from core client for 30 sec - exiting 20:46:16 (5028): No heartbeat from core client for 30 sec - exiting 20:46:17 (5028): No heartbeat from core client for 30 sec - exiting 20:46:18 (5028): No heartbeat from core client for 30 sec - exiting 20:46:19 (5028): No heartbeat from core client for 30 sec - exiting 20:46:20 (5028): No heartbeat from core client for 30 sec - exiting 20:46:21 (5028): No heartbeat from core client for 30 sec - exiting 20:46:22 (5028): No heartbeat from core client for 30 sec - exiting 20:46:23 (5028): No heartbeat from core client for 30 sec - exiting 20:46:24 (5028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:46:25 (5028): No heartbeat from core client for 30 sec - exiting 20:51:15 (252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:11:20 (4752): No heartbeat from core client for 30 sec - exiting 19:11:21 (4752): No heartbeat from core client for 30 sec - exiting 19:11:22 (4752): No heartbeat from core client for 30 sec - exiting 19:11:23 (4752): No heartbeat from core client for 30 sec - exiting 19:11:24 (4752): No heartbeat from core client for 30 sec - exiting 19:11:25 (4752): No heartbeat from core client for 30 sec - exiting 19:11:26 (4752): No heartbeat from core client for 30 sec - exiting 19:11:27 (4752): No heartbeat from core client for 30 sec - exiting 19:11:28 (4752): No heartbeat from core client for 30 sec - exiting 19:11:29 (4752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:36:12 (4272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:02:12 (4540): No heartbeat from core client for 30 sec - exiting 19:02:13 (4540): No heartbeat from core client for 30 sec - exiting 19:02:15 (4540): No heartbeat from core client for 30 sec - exiting 19:02:16 (4540): No heartbeat from core client for 30 sec - exiting 19:02:17 (4540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4388, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4392, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 20:35:59 (3344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:13:00 (1980): No heartbeat from core client for 30 sec - exiting 21:13:01 (1980): No heartbeat from core client for 30 sec - exiting 21:13:02 (1980): No heartbeat from core client for 30 sec - exiting 21:13:03 (1980): No heartbeat from core client for 30 sec - exiting 21:13:04 (1980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4832, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4832, iMonCtr=1 Model crash detected, will try to restart... 20:27:19 (2924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 08:52:05 (6096): No heartbeat from core client for 30 sec - exiting 08:52:06 (6096): No heartbeat from core client for 30 sec - exiting 08:52:07 (6096): No heartbeat from core client for 30 sec - exiting 08:52:08 (6096): No heartbeat from core client for 30 sec - exiting 08:52:09 (6096): No heartbeat from core client for 30 sec - exiting 08:52:10 (6096): No heartbeat from core client for 30 sec - exiting 08:52:11 (6096): No heartbeat from core client for 30 sec - exiting 08:52:12 (6096): No heartbeat from core client for 30 sec - exiting 08:52:13 (6096): No heartbeat from core client for 30 sec - exiting 08:52:14 (6096): No heartbeat from core client for 30 sec - exiting 08:52:15 (6096): No heartbeat from core client for 30 sec - exiting 08:52:16 (6096): No heartbeat from core client for 30 sec - exiting 08:52:17 (6096): No heartbeat from core client for 30 sec - exiting 08:52:18 (6096): No heartbeat from core client for 30 sec - exiting 08:52:19 (6096): No heartbeat from core client for 30 sec - exiting 08:52:20 (6096): No heartbeat from core client for 30 sec - exiting 08:52:21 (6096): No heartbeat from core client for 30 sec - exiting 08:52:22 (6096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:16:41 (5100): No heartbeat from core client for 30 sec - exiting 09:16:42 (5100): No heartbeat from core client for 30 sec - exiting 09:16:43 (5100): No heartbeat from core client for 30 sec - exiting 09:16:44 (5100): No heartbeat from core client for 30 sec - exiting 09:16:45 (5100): No heartbeat from core client for 30 sec - exiting 09:16:46 (5100): No heartbeat from core client for 30 sec - exiting 09:16:47 (5100): No heartbeat from core client for 30 sec - exiting 09:16:48 (5100): No heartbeat from core client for 30 sec - exiting 09:16:49 (5100): No heartbeat from core client for 30 sec - exiting 09:16:50 (5100): No heartbeat from core client for 30 sec - exiting 09:16:51 (5100): No heartbeat from core client for 30 sec - exiting 09:16:52 (5100): No heartbeat from core client for 30 sec - exiting 09:16:53 (5100): No heartbeat from core client for 30 sec - exiting 09:16:54 (5100): No heartbeat from core client for 30 sec - exiting 09:16:55 (5100): No heartbeat from core client for 30 sec - exiting 09:16:56 (5100): No heartbeat from core client for 30 sec - exiting 09:16:57 (5100): No heartbeat from core client for 30 sec - exiting 09:16:58 (5100): No heartbeat from core client for 30 sec - exiting 09:16:59 (5100): No heartbeat from core client for 30 sec - exiting 09:17:00 (5100): No heartbeat from core client for 30 sec - exiting 09:17:01 (5100): No heartbeat from core client for 30 sec - exiting 09:17:02 (5100): No heartbeat from core client for 30 sec - exiting 09:17:03 (5100): No heartbeat from core client for 30 sec - exiting 09:17:04 (5100): No heartbeat from core client for 30 sec - exiting 09:17:05 (5100): No heartbeat from core client for 30 sec - exiting 09:17:06 (5100): No heartbeat from core client for 30 sec - exiting 09:17:07 (5100): No heartbeat from core client for 30 sec - exiting 09:17:08 (5100): No heartbeat from core client for 30 sec - exiting 09:17:09 (5100): No heartbeat from core client for 30 sec - exiting 09:17:10 (5100): No heartbeat from core client for 30 sec - exiting 09:17:11 (5100): No heartbeat from core client for 30 sec - exiting 09:17:12 (5100): No heartbeat from core client for 30 sec - exiting 09:17:13 (5100): No heartbeat from core client for 30 sec - exiting 09:17:14 (5100): No heartbeat from core client for 30 sec - exiting 09:17:15 (5100): No heartbeat from core client for 30 sec - exiting 09:17:16 (5100): No heartbeat from core client for 30 sec - exiting 09:17:17 (5100): No heartbeat from core client for 30 sec - exiting 09:17:19 (5100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:20:01 (2392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:11:51 (5676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7508, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 18:53:00 (2500): No heartbeat from core client for 30 sec - exiting 18:53:01 (2500): No heartbeat from core client for 30 sec - exiting 18:53:02 (2500): No heartbeat from core client for 30 sec - exiting 18:53:03 (2500): No heartbeat from core client for 30 sec - exiting 18:53:04 (2500): No heartbeat from core client for 30 sec - exiting 18:53:05 (2500): No heartbeat from core client for 30 sec - exiting 18:53:06 (2500): No heartbeat from core client for 30 sec - exiting 18:53:07 (2500): No heartbeat from core client for 30 sec - exiting 18:53:08 (2500): No heartbeat from core client for 30 sec - exiting 18:53:09 (2500): No heartbeat from core client for 30 sec - exiting 18:53:10 (2500): No heartbeat from core client for 30 sec - exiting 18:53:11 (2500): No heartbeat from core client for 30 sec - exiting 18:53:12 (2500): No heartbeat from core client for 30 sec - exiting 18:53:13 (2500): No heartbeat from core client for 30 sec - exiting 18:53:14 (2500): No heartbeat from core client for 30 sec - exiting 18:53:15 (2500): No heartbeat from core client for 30 sec - exiting 18:53:16 (2500): No heartbeat from core client for 30 sec - exiting 18:53:17 (2500): No heartbeat from core client for 30 sec - exiting 18:53:18 (2500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:53:19 (2500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6172, iMonCtr=1 Model crash detected, will try to restart... 19:10:29 (5968): No heartbeat from core client for 30 sec - exiting 19:10:30 (5968): No heartbeat from core client for 30 sec - exiting 19:10:31 (5968): No heartbeat from core client for 30 sec - exiting 19:10:32 (5968): No heartbeat from core client for 30 sec - exiting 19:10:33 (5968): No heartbeat from core client for 30 sec - exiting 19:10:34 (5968): No heartbeat from core client for 30 sec - exiting 19:10:35 (5968): No heartbeat from core client for 30 sec - exiting 19:10:36 (5968): No heartbeat from core client for 30 sec - exiting 19:10:37 (5968): No heartbeat from core client for 30 sec - exiting 19:10:38 (5968): No heartbeat from core client for 30 sec - exiting 19:10:39 (5968): No heartbeat from core client for 30 sec - exiting 19:10:40 (5968): No heartbeat from core client for 30 sec - exiting 19:10:41 (5968): No heartbeat from core client for 30 sec - exiting 19:10:42 (5968): No heartbeat from core client for 30 sec - exiting 19:10:43 (5968): No heartbeat from core client for 30 sec - exiting 19:10:44 (5968): No heartbeat from core client for 30 sec - exiting 19:10:45 (5968): No heartbeat from core client for 30 sec - exiting 19:10:46 (5968): No heartbeat from core client for 30 sec - exiting 19:10:47 (5968): No heartbeat from core client for 30 sec - exiting 19:10:48 (5968): No heartbeat from core client for 30 sec - exiting 19:10:49 (5968): No heartbeat from core client for 30 sec - exiting 19:10:50 (5968): No heartbeat from core client for 30 sec - exiting 19:10:51 (5968): No heartbeat from core client for 30 sec - exiting 19:10:52 (5968): No heartbeat from core client for 30 sec - exiting 19:10:53 (5968): No heartbeat from core client for 30 sec - exiting 19:10:54 (5968): No heartbeat from core client for 30 sec - exiting 19:10:55 (5968): No heartbeat from core client for 30 sec - exiting 19:10:56 (5968): No heartbeat from core client for 30 sec - exiting 19:10:57 (5968): No heartbeat from core client for 30 sec - exiting 19:10:58 (5968): No heartbeat from core client for 30 sec - exiting 19:10:59 (5968): No heartbeat from core client for 30 sec - exiting 19:11:00 (5968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:16:09 (6936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4072, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4672, iMonCtr=1 Model crash detected, will try to restart... 08:33:34 (4972): No heartbeat from core client for 30 sec - exiting 08:33:35 (4972): No heartbeat from core client for 30 sec - exiting 08:33:36 (4972): No heartbeat from core client for 30 sec - exiting 08:33:37 (4972): No heartbeat from core client for 30 sec - exiting 08:33:38 (4972): No heartbeat from core client for 30 sec - exiting 08:33:39 (4972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:19:38 (4980): No heartbeat from core client for 30 sec - exiting 17:19:39 (4980): No heartbeat from core client for 30 sec - exiting 17:19:40 (4980): No heartbeat from core client for 30 sec - exiting 17:19:41 (4980): No heartbeat from core client for 30 sec - exiting 17:19:42 (4980): No heartbeat from core client for 30 sec - exiting 17:19:43 (4980): No heartbeat from core client for 30 sec - exiting 17:19:44 (4980): No heartbeat from core client for 30 sec - exiting 17:19:45 (4980): No heartbeat from core client for 30 sec - exiting 17:19:46 (4980): No heartbeat from core client for 30 sec - exiting 17:19:47 (4980): No heartbeat from core client for 30 sec - exiting 17:19:48 (4980): No heartbeat from core client for 30 sec - exiting 17:19:49 (4980): No heartbeat from core client for 30 sec - exiting 17:19:50 (4980): No heartbeat from core client for 30 sec - exiting 17:19:51 (4980): No heartbeat from core client for 30 sec - exiting 17:19:52 (4980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4564, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4652, iMonCtr=1 Model crash detected, will try to restart... Model crashed: TRANSO2A: Missing data in ocean UV fields tmp/pipe_dummy 2048 Model crashed: TRANSO2A: Missing data in ocean UV fields tmp/pipe_dummy 2048 Model crashed: TRANSO2A: Missing data in ocean UV fields tmp/pipe_dummy 2048 Model crashed: TRANSO2A: Missing data in ocean UV fields tmp/pipe_dummy 2048 Model crashed: TRANSO2A: Missing data in ocean UV fields tmp/pipe_dummy 2048 Model crashed: TRANSO2A: Missing data in ocean UV fields tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
16 Mar 2013 17:56:31	1152504	15598982	hadcm3n_47ux_1940_40_008311378_0	207,360	351,282	1.6941
12 Mar 2013 18:46:52	1152504	15598982	hadcm3n_47ux_1940_40_008311378_0	181,440	307,699	1.6959
08 Mar 2013 20:43:09	1152504	15598982	hadcm3n_47ux_1940_40_008311378_0	155,520	263,435	1.6939
07 Mar 2013 09:56:14	1152504	15598982	hadcm3n_47ux_1940_40_008311378_0	129,600	219,815	1.6961
05 Mar 2013 12:36:53	1152504	15598982	hadcm3n_47ux_1940_40_008311378_0	103,680	174,380	1.6819
27 Feb 2013 21:18:56	1152504	15598982	hadcm3n_47ux_1940_40_008311378_0	77,760	132,387	1.7025
18 Feb 2013 19:42:24	1152504	15598982	hadcm3n_47ux_1940_40_008311378_0	51,840	86,627	1.6710
10 Feb 2013 19:45:07	1152504	15598982	hadcm3n_47ux_1940_40_008311378_0	25,920	41,805	1.6128