Task 16080225

Name	hadcm3n_o3rc_2020_40_008366915_2
Workunit	8517774
Created	14 Nov 2013, 1:20:49 UTC
Sent	14 Nov 2013, 1:20:55 UTC
Report deadline	13 Feb 2014, 8:48:06 UTC
Received	24 Nov 2013, 9:16:01 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	25 (0x00000019) Unknown error code
Computer ID	1230923
Run time	4 days 9 hours 39 min 18 sec
CPU time	4 days 0 hours 21 min 10 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.84 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.28</core_client_version> <![CDATA[ <message> Не удается найти заданную область или дорожку на диске. (0x19) - exit code 25 (0x19) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1552, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1756, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1756, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1756, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1756, iMonCtr=1 Model crash detected, will try to restart... 12:22:18 (2976): No heartbeat from core client for 30 sec - exiting 12:22:19 (2976): No heartbeat from core client for 30 sec - exiting 12:22:21 (2976): No heartbeat from core client for 30 sec - exiting 12:22:22 (2976): No heartbeat from core client for 30 sec - exiting 12:22:23 (2976): No heartbeat from core client for 30 sec - exiting 12:22:24 (2976): No heartbeat from core client for 30 sec - exiting 12:22:25 (2976): No heartbeat from core client for 30 sec - exiting 12:22:26 (2976): No heartbeat from core client for 30 sec - exiting 12:22:27 (2976): No heartbeat from core client for 30 sec - exiting 12:22:28 (2976): No heartbeat from core client for 30 sec - exiting 12:22:29 (2976): No heartbeat from core client for 30 sec - exiting 12:22:30 (2976): No heartbeat from core client for 30 sec - exiting 12:22:31 (2976): No heartbeat from core client for 30 sec - exiting 12:22:33 (2976): No heartbeat from core client for 30 sec - exiting 12:22:34 (2976): No heartbeat from core client for 30 sec - exiting 12:22:35 (2976): No heartbeat from core client for 30 sec - exiting 12:22:36 (2976): No heartbeat from core client for 30 sec - exiting 12:22:37 (2976): No heartbeat from core client for 30 sec - exiting 12:22:38 (2976): No heartbeat from core client for 30 sec - exiting 12:22:39 (2976): No heartbeat from core client for 30 sec - exiting 12:22:40 (2976): No heartbeat from core client for 30 sec - exiting 12:22:41 (2976): No heartbeat from core client for 30 sec - exiting 12:22:42 (2976): No heartbeat from core client for 30 sec - exiting 12:22:43 (2976): No heartbeat from core client for 30 sec - exiting 12:22:45 (2976): No heartbeat from core client for 30 sec - exiting 12:22:46 (2976): No heartbeat from core client for 30 sec - exiting 12:22:47 (2976): No heartbeat from core client for 30 sec - exiting 12:22:48 (2976): No heartbeat from core client for 30 sec - exiting 12:22:49 (2976): No heartbeat from core client for 30 sec - exiting 12:22:50 (2976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:13:46 (3800): No heartbeat from core client for 30 sec - exiting 00:13:47 (3800): No heartbeat from core client for 30 sec - exiting 00:13:48 (3800): No heartbeat from core client for 30 sec - exiting 00:13:49 (3800): No heartbeat from core client for 30 sec - exiting 00:13:51 (3800): No heartbeat from core client for 30 sec - exiting 00:13:52 (3800): No heartbeat from core client for 30 sec - exiting 00:13:53 (3800): No heartbeat from core client for 30 sec - exiting 00:13:54 (3800): No heartbeat from core client for 30 sec - exiting 00:13:55 (3800): No heartbeat from core client for 30 sec - exiting 00:13:56 (3800): No heartbeat from core client for 30 sec - exiting 00:13:57 (3800): No heartbeat from core client for 30 sec - exiting 00:13:58 (3800): No heartbeat from core client for 30 sec - exiting 00:13:59 (3800): No heartbeat from core client for 30 sec - exiting 00:14:00 (3800): No heartbeat from core client for 30 sec - exiting 00:14:01 (3800): No heartbeat from core client for 30 sec - exiting 00:14:03 (3800): No heartbeat from core client for 30 sec - exiting 00:14:04 (3800): No heartbeat from core client for 30 sec - exiting 00:14:05 (3800): No heartbeat from core client for 30 sec - exiting 00:14:06 (3800): No heartbeat from core client for 30 sec - exiting 00:14:07 (3800): No heartbeat from core client for 30 sec - exiting 00:14:08 (3800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:32:09 (3996): No heartbeat from core client for 30 sec - exiting 01:32:10 (3996): No heartbeat from core client for 30 sec - exiting 01:32:11 (3996): No heartbeat from core client for 30 sec - exiting 01:32:12 (3996): No heartbeat from core client for 30 sec - exiting 01:32:13 (3996): No heartbeat from core client for 30 sec - exiting 01:32:14 (3996): No heartbeat from core client for 30 sec - exiting 01:32:15 (3996): No heartbeat from core client for 30 sec - exiting 01:32:16 (3996): No heartbeat from core client for 30 sec - exiting 01:32:17 (3996): No heartbeat from core client for 30 sec - exiting 01:32:19 (3996): No heartbeat from core client for 30 sec - exiting 01:32:20 (3996): No heartbeat from core client for 30 sec - exiting 01:32:21 (3996): No heartbeat from core client for 30 sec - exiting 01:32:22 (3996): No heartbeat from core client for 30 sec - exiting 01:32:23 (3996): No heartbeat from core client for 30 sec - exiting 01:32:24 (3996): No heartbeat from core client for 30 sec - exiting 01:32:25 (3996): No heartbeat from core client for 30 sec - exiting 01:32:26 (3996): No heartbeat from core client for 30 sec - exiting 01:32:27 (3996): No heartbeat from core client for 30 sec - exiting 01:32:28 (3996): No heartbeat from core client for 30 sec - exiting 01:32:29 (3996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:38:32 (3308): No heartbeat from core client for 30 sec - exiting 01:38:33 (3308): No heartbeat from core client for 30 sec - exiting 01:38:34 (3308): No heartbeat from core client for 30 sec - exiting 01:38:35 (3308): No heartbeat from core client for 30 sec - exiting 01:38:36 (3308): No heartbeat from core client for 30 sec - exiting 01:38:37 (3308): No heartbeat from core client for 30 sec - exiting 01:38:38 (3308): No heartbeat from core client for 30 sec - exiting 01:38:39 (3308): No heartbeat from core client for 30 sec - exiting 01:38:40 (3308): No heartbeat from core client for 30 sec - exiting 01:38:41 (3308): No heartbeat from core client for 30 sec - exiting 01:38:43 (3308): No heartbeat from core client for 30 sec - exiting 01:38:44 (3308): No heartbeat from core client for 30 sec - exiting 01:38:45 (3308): No heartbeat from core client for 30 sec - exiting 01:38:46 (3308): No heartbeat from core client for 30 sec - exiting 01:38:47 (3308): No heartbeat from core client for 30 sec - exiting 01:38:48 (3308): No heartbeat from core client for 30 sec - exiting 01:38:49 (3308): No heartbeat from core client for 30 sec - exiting 01:38:50 (3308): No heartbeat from core client for 30 sec - exiting 01:38:51 (3308): No heartbeat from core client for 30 sec - exiting 01:38:52 (3308): No heartbeat from core client for 30 sec - exiting 01:38:54 (3308): No heartbeat from core client for 30 sec - exiting 01:38:55 (3308): No heartbeat from core client for 30 sec - exiting 01:38:56 (3308): No heartbeat from core client for 30 sec - exiting 01:38:57 (3308): No heartbeat from core client for 30 sec - exiting 01:38:58 (3308): No heartbeat from core client for 30 sec - exiting 01:38:59 (3308): No heartbeat from core client for 30 sec - exiting 01:39:00 (3308): No heartbeat from core client for 30 sec - exiting 01:39:01 (3308): No heartbeat from core client for 30 sec - exiting 01:39:02 (3308): No heartbeat from core client for 30 sec - exiting 01:39:03 (3308): No heartbeat from core client for 30 sec - exiting 01:39:04 (3308): No heartbeat from core client for 30 sec - exiting 01:39:06 (3308): No heartbeat from core client for 30 sec - exiting 01:39:07 (3308): No heartbeat from core client for 30 sec - exiting 01:39:08 (3308): No heartbeat from core client for 30 sec - exiting 01:39:09 (3308): No heartbeat from core client for 30 sec - exiting 01:39:10 (3308): No heartbeat from core client for 30 sec - exiting 01:39:11 (3308): No heartbeat from core client for 30 sec - exiting 01:39:12 (3308): No heartbeat from core client for 30 sec - exiting 01:39:13 (3308): No heartbeat from core client for 30 sec - exiting 01:39:14 (3308): No heartbeat from core client for 30 sec - exiting 01:39:15 (3308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:42:56 (3960): No heartbeat from core client for 30 sec - exiting 22:42:57 (3960): No heartbeat from core client for 30 sec - exiting 22:42:58 (3960): No heartbeat from core client for 30 sec - exiting 22:42:59 (3960): No heartbeat from core client for 30 sec - exiting 22:43:00 (3960): No heartbeat from core client for 30 sec - exiting 22:43:01 (3960): No heartbeat from core client for 30 sec - exiting 22:43:02 (3960): No heartbeat from core client for 30 sec - exiting 22:43:03 (3960): No heartbeat from core client for 30 sec - exiting 22:43:05 (3960): No heartbeat from core client for 30 sec - exiting 22:43:06 (3960): No heartbeat from core client for 30 sec - exiting 22:43:07 (3960): No heartbeat from core client for 30 sec - exiting 22:43:08 (3960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:04:45 (3840): No heartbeat from core client for 30 sec - exiting 21:04:46 (3840): No heartbeat from core client for 30 sec - exiting 21:04:47 (3840): No heartbeat from core client for 30 sec - exiting 21:04:48 (3840): No heartbeat from core client for 30 sec - exiting 21:04:49 (3840): No heartbeat from core client for 30 sec - exiting 21:04:50 (3840): No heartbeat from core client for 30 sec - exiting 21:04:51 (3840): No heartbeat from core client for 30 sec - exiting 21:04:52 (3840): No heartbeat from core client for 30 sec - exiting 21:04:53 (3840): No heartbeat from core client for 30 sec - exiting 21:04:54 (3840): No heartbeat from core client for 30 sec - exiting 21:04:56 (3840): No heartbeat from core client for 30 sec - exiting 21:04:57 (3840): No heartbeat from core client for 30 sec - exiting 21:04:58 (3840): No heartbeat from core client for 30 sec - exiting 21:04:59 (3840): No heartbeat from core client for 30 sec - exiting 21:05:00 (3840): No heartbeat from core client for 30 sec - exiting 21:05:01 (3840): No heartbeat from core client for 30 sec - exiting 21:05:02 (3840): No heartbeat from core client for 30 sec - exiting 21:05:03 (3840): No heartbeat from core client for 30 sec - exiting 21:05:04 (3840): No heartbeat from core client for 30 sec - exiting 21:05:05 (3840): No heartbeat from core client for 30 sec - exiting 21:05:06 (3840): No heartbeat from core client for 30 sec - exiting 21:05:08 (3840): No heartbeat from core client for 30 sec - exiting 21:05:09 (3840): No heartbeat from core client for 30 sec - exiting 21:05:10 (3840): No heartbeat from core client for 30 sec - exiting 21:05:11 (3840): No heartbeat from core client for 30 sec - exiting 21:05:12 (3840): No heartbeat from core client for 30 sec - exiting 21:05:13 (3840): No heartbeat from core client for 30 sec - exiting 21:05:14 (3840): No heartbeat from core client for 30 sec - exiting 21:05:15 (3840): No heartbeat from core client for 30 sec - exiting 21:05:16 (3840): No heartbeat from core client for 30 sec - exiting 21:05:17 (3840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:43:48 (3644): No heartbeat from core client for 30 sec - exiting 00:43:49 (3644): No heartbeat from core client for 30 sec - exiting 00:43:50 (3644): No heartbeat from core client for 30 sec - exiting 00:43:51 (3644): No heartbeat from core client for 30 sec - exiting 00:43:53 (3644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:04:58 (4080): No heartbeat from core client for 30 sec - exiting 23:04:59 (4080): No heartbeat from core client for 30 sec - exiting 23:05:00 (4080): No heartbeat from core client for 30 sec - exiting 23:05:01 (4080): No heartbeat from core client for 30 sec - exiting 23:05:02 (4080): No heartbeat from core client for 30 sec - exiting 23:05:03 (4080): No heartbeat from core client for 30 sec - exiting 23:05:04 (4080): No heartbeat from core client for 30 sec - exiting 23:05:05 (4080): No heartbeat from core client for 30 sec - exiting 23:05:06 (4080): No heartbeat from core client for 30 sec - exiting 23:05:07 (4080): No heartbeat from core client for 30 sec - exiting 23:05:08 (4080): No heartbeat from core client for 30 sec - exiting 23:05:09 (4080): No heartbeat from core client for 30 sec - exiting 23:05:10 (4080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:23:22 (3312): No heartbeat from core client for 30 sec - exiting 01:23:24 (3312): No heartbeat from core client for 30 sec - exiting 01:23:25 (3312): No heartbeat from core client for 30 sec - exiting 01:23:26 (3312): No heartbeat from core client for 30 sec - exiting 01:23:27 (3312): No heartbeat from core client for 30 sec - exiting 01:23:28 (3312): No heartbeat from core client for 30 sec - exiting 01:23:29 (3312): No heartbeat from core client for 30 sec - exiting 01:23:30 (3312): No heartbeat from core client for 30 sec - exiting 01:23:31 (3312): No heartbeat from core client for 30 sec - exiting 01:23:32 (3312): No heartbeat from core client for 30 sec - exiting 01:23:33 (3312): No heartbeat from core client for 30 sec - exiting 01:23:34 (3312): No heartbeat from core client for 30 sec - exiting 01:23:36 (3312): No heartbeat from core client for 30 sec - exiting 01:23:37 (3312): No heartbeat from core client for 30 sec - exiting 01:23:38 (3312): No heartbeat from core client for 30 sec - exiting 01:23:39 (3312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:43:44 (3648): No heartbeat from core client for 30 sec - exiting 11:43:45 (3648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:38:40 (3020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:19:19 (3636): No heartbeat from core client for 30 sec - exiting 13:19:20 (3636): No heartbeat from core client for 30 sec - exiting 13:19:21 (3636): No heartbeat from core client for 30 sec - exiting 13:19:22 (3636): No heartbeat from core client for 30 sec - exiting 13:19:23 (3636): No heartbeat from core client for 30 sec - exiting 13:19:24 (3636): No heartbeat from core client for 30 sec - exiting 13:19:25 (3636): No heartbeat from core client for 30 sec - exiting 13:19:26 (3636): No heartbeat from core client for 30 sec - exiting 13:19:27 (3636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:04:33 (3564): No heartbeat from core client for 30 sec - exiting 14:04:34 (3564): No heartbeat from core client for 30 sec - exiting 14:04:35 (3564): No heartbeat from core client for 30 sec - exiting 14:04:36 (3564): No heartbeat from core client for 30 sec - exiting 14:04:37 (3564): No heartbeat from core client for 30 sec - exiting 14:04:39 (3564): No heartbeat from core client for 30 sec - exiting 14:04:40 (3564): No heartbeat from core client for 30 sec - exiting 14:04:41 (3564): No heartbeat from core client for 30 sec - exiting 14:04:42 (3564): No heartbeat from core client for 30 sec - exiting 14:04:43 (3564): No heartbeat from core client for 30 sec - exiting 14:04:44 (3564): No heartbeat from core client for 30 sec - exiting 14:04:45 (3564): No heartbeat from core client for 30 sec - exiting 14:04:46 (3564): No heartbeat from core client for 30 sec - exiting 14:04:47 (3564): No heartbeat from core client for 30 sec - exiting 14:04:48 (3564): No heartbeat from core client for 30 sec - exiting 14:04:50 (3564): No heartbeat from core client for 30 sec - exiting 14:04:51 (3564): No heartbeat from core client for 30 sec - exiting 14:04:52 (3564): No heartbeat from core client for 30 sec - exiting 14:04:53 (3564): No heartbeat from core client for 30 sec - exiting 14:04:54 (3564): No heartbeat from core client for 30 sec - exiting 14:04:55 (3564): No heartbeat from core client for 30 sec - exiting 14:04:56 (3564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
24 Nov 2013 01:04:54	1230923	16080225	hadcm3n_o3rc_2020_40_008366915_2	259,200	322,234	1.2432
22 Nov 2013 23:34:48	1230923	16080225	hadcm3n_o3rc_2020_40_008366915_2	233,280	278,470	1.1937
21 Nov 2013 23:37:38	1230923	16080225	hadcm3n_o3rc_2020_40_008366915_2	207,360	244,940	1.1812
20 Nov 2013 21:50:48	1230923	16080225	hadcm3n_o3rc_2020_40_008366915_2	181,440	211,717	1.1669
19 Nov 2013 23:58:58	1230923	16080225	hadcm3n_o3rc_2020_40_008366915_2	155,520	178,422	1.1473
18 Nov 2013 23:42:09	1230923	16080225	hadcm3n_o3rc_2020_40_008366915_2	129,600	145,011	1.1189
17 Nov 2013 21:12:00	1230923	16080225	hadcm3n_o3rc_2020_40_008366915_2	103,680	112,969	1.0896
16 Nov 2013 10:25:46	1230923	16080225	hadcm3n_o3rc_2020_40_008366915_2	77,760	78,387	1.0081
15 Nov 2013 22:22:42	1230923	16080225	hadcm3n_o3rc_2020_40_008366915_2	51,840	71,200	1.3735
15 Nov 2013 00:03:54	1230923	16080225	hadcm3n_o3rc_2020_40_008366915_2	25,920	35,639	1.3750