Task 13103802

Name	hadcm3n_yd79_1900_40_007349967_1
Workunit	7547397
Created	6 Jul 2011, 14:02:36 UTC
Sent	17 Jul 2011, 7:32:40 UTC
Report deadline	16 Oct 2011, 14:59:51 UTC
Received	6 Aug 2011, 8:11:07 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	25 (0x00000019) Unknown error code
Computer ID	1158195
Run time	11 days 3 hours 6 min 54 sec
CPU time	10 days 15 hours 26 min 1 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	1.09 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.33</core_client_version> <![CDATA[ <message> The drive cannot locate a specific area or track on the disk. (0x19) - exit code 25 (0x19) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 05:12:41 (3088): No heartbeat from core client for 30 sec - exiting 05:12:42 (3088): No heartbeat from core client for 30 sec - exiting 05:12:43 (3088): No heartbeat from core client for 30 sec - exiting 05:12:44 (3088): No heartbeat from core client for 30 sec - exiting 05:12:46 (3088): No heartbeat from core client for 30 sec - exiting 05:12:47 (3088): No heartbeat from core client for 30 sec - exiting 05:12:48 (3088): No heartbeat from core client for 30 sec - exiting 05:12:49 (3088): No heartbeat from core client for 30 sec - exiting 05:12:50 (3088): No heartbeat from core client for 30 sec - exiting 05:12:51 (3088): No heartbeat from core client for 30 sec - exiting 05:12:52 (3088): No heartbeat from core client for 30 sec - exiting 05:12:53 (3088): No heartbeat from core client for 30 sec - exiting 05:12:54 (3088): No heartbeat from core client for 30 sec - exiting 05:12:55 (3088): No heartbeat from core client for 30 sec - exiting 05:12:56 (3088): No heartbeat from core client for 30 sec - exiting 05:12:57 (3088): No heartbeat from core client for 30 sec - exiting 05:12:58 (3088): No heartbeat from core client for 30 sec - exiting 05:12:59 (3088): No heartbeat from core client for 30 sec - exiting 05:13:00 (3088): No heartbeat from core client for 30 sec - exiting 05:13:01 (3088): No heartbeat from core client for 30 sec - exiting 05:13:02 (3088): No heartbeat from core client for 30 sec - exiting 05:13:03 (3088): No heartbeat from core client for 30 sec - exiting 05:13:04 (3088): No heartbeat from core client for 30 sec - exiting 05:13:05 (3088): No heartbeat from core client for 30 sec - exiting 05:13:06 (3088): No heartbeat from core client for 30 sec - exiting 05:13:07 (3088): No heartbeat from core client for 30 sec - exiting 05:13:08 (3088): No heartbeat from core client for 30 sec - exiting 05:13:10 (3088): No heartbeat from core client for 30 sec - exiting 05:13:11 (3088): No heartbeat from core client for 30 sec - exiting 05:13:12 (3088): No heartbeat from core client for 30 sec - exiting 05:13:13 (3088): No heartbeat from core client for 30 sec - exiting 05:13:14 (3088): No heartbeat from core client for 30 sec - exiting 05:13:15 (3088): No heartbeat from core client for 30 sec - exiting 05:13:16 (3088): No heartbeat from core client for 30 sec - exiting 05:13:17 (3088): No heartbeat from core client for 30 sec - exiting 05:13:18 (3088): No heartbeat from core client for 30 sec - exiting 05:13:19 (3088): No heartbeat from core client for 30 sec - exiting 05:13:20 (3088): No heartbeat from core client for 30 sec - exiting 05:13:22 (3088): No heartbeat from core client for 30 sec - exiting 05:13:23 (3088): No heartbeat from core client for 30 sec - exiting 05:13:24 (3088): No heartbeat from core client for 30 sec - exiting 05:13:25 (3088): No heartbeat from core client for 30 sec - exiting 05:13:26 (3088): No heartbeat from core client for 30 sec - exiting 05:13:27 (3088): No heartbeat from core client for 30 sec - exiting 05:13:28 (3088): No heartbeat from core client for 30 sec - exiting 05:13:29 (3088): No heartbeat from core client for 30 sec - exiting 05:13:30 (3088): No heartbeat from core client for 30 sec - exiting 05:13:31 (3088): No heartbeat from core client for 30 sec - exiting 05:13:32 (3088): No heartbeat from core client for 30 sec - exiting 05:13:34 (3088): No heartbeat from core client for 30 sec - exiting 05:13:35 (3088): No heartbeat from core client for 30 sec - exiting 05:13:36 (3088): No heartbeat from core client for 30 sec - exiting 05:13:37 (3088): No heartbeat from core client for 30 sec - exiting 05:13:38 (3088): No heartbeat from core client for 30 sec - exiting 05:13:39 (3088): No heartbeat from core client for 30 sec - exiting 05:13:40 (3088): No heartbeat from core client for 30 sec - exiting 05:13:41 (3088): No heartbeat from core client for 30 sec - exiting 05:13:42 (3088): No heartbeat from core client for 30 sec - exiting 05:13:43 (3088): No heartbeat from core client for 30 sec - exiting 05:13:44 (3088): No heartbeat from core client for 30 sec - exiting 05:13:46 (3088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:39:39 (6524): No heartbeat from core client for 30 sec - exiting 14:39:40 (6524): No heartbeat from core client for 30 sec - exiting 14:39:41 (6524): No heartbeat from core client for 30 sec - exiting 14:39:42 (6524): No heartbeat from core client for 30 sec - exiting 14:39:43 (6524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:44:27 (504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:44:35 (504): No heartbeat from core client for 30 sec - exiting 14:44:36 (504): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 00:43:05 (5712): No heartbeat from core client for 30 sec - exiting 00:43:07 (5712): No heartbeat from core client for 30 sec - exiting 00:43:08 (5712): No heartbeat from core client for 30 sec - exiting 00:43:09 (5712): No heartbeat from core client for 30 sec - exiting 00:43:10 (5712): No heartbeat from core client for 30 sec - exiting 00:43:11 (5712): No heartbeat from core client for 30 sec - exiting 00:43:12 (5712): No heartbeat from core client for 30 sec - exiting 00:43:13 (5712): No heartbeat from core client for 30 sec - exiting 00:43:14 (5712): No heartbeat from core client for 30 sec - exiting 00:43:15 (5712): No heartbeat from core client for 30 sec - exiting 00:43:16 (5712): No heartbeat from core client for 30 sec - exiting 00:43:18 (5712): No heartbeat from core client for 30 sec - exiting 00:43:19 (5712): No heartbeat from core client for 30 sec - exiting 00:43:20 (5712): No heartbeat from core client for 30 sec - exiting 00:43:21 (5712): No heartbeat from core client for 30 sec - exiting 00:43:22 (5712): No heartbeat from core client for 30 sec - exiting 00:43:23 (5712): No heartbeat from core client for 30 sec - exiting 00:43:24 (5712): No heartbeat from core client for 30 sec - exiting 00:43:25 (5712): No heartbeat from core client for 30 sec - exiting 00:43:26 (5712): No heartbeat from core client for 30 sec - exiting 00:43:27 (5712): No heartbeat from core client for 30 sec - exiting 00:43:28 (5712): No heartbeat from core client for 30 sec - exiting 00:43:29 (5712): No heartbeat from core client for 30 sec - exiting 00:43:30 (5712): No heartbeat from core client for 30 sec - exiting 00:43:31 (5712): No heartbeat from core client for 30 sec - exiting 00:43:32 (5712): No heartbeat from core client for 30 sec - exiting 00:43:33 (5712): No heartbeat from core client for 30 sec - exiting 00:43:34 (5712): No heartbeat from core client for 30 sec - exiting 00:43:35 (5712): No heartbeat from core client for 30 sec - exiting 00:43:36 (5712): No heartbeat from core client for 30 sec - exiting 00:43:37 (5712): No heartbeat from core client for 30 sec - exiting 00:43:39 (5712): No heartbeat from core client for 30 sec - exiting 00:43:40 (5712): No heartbeat from core client for 30 sec - exiting 00:43:41 (5712): No heartbeat from core client for 30 sec - exiting 00:43:42 (5712): No heartbeat from core client for 30 sec - exiting 00:43:43 (5712): No heartbeat from core client for 30 sec - exiting 00:43:44 (5712): No heartbeat from core client for 30 sec - exiting 00:43:45 (5712): No heartbeat from core client for 30 sec - exiting 00:43:46 (5712): No heartbeat from core client for 30 sec - exiting 00:43:47 (5712): No heartbeat from core client for 30 sec - exiting 00:43:48 (5712): No heartbeat from core client for 30 sec - exiting 00:43:49 (5712): No heartbeat from core client for 30 sec - exiting 00:43:51 (5712): No heartbeat from core client for 30 sec - exiting 00:43:52 (5712): No heartbeat from core client for 30 sec - exiting 00:43:53 (5712): No heartbeat from core client for 30 sec - exiting 00:43:54 (5712): No heartbeat from core client for 30 sec - exiting 00:43:55 (5712): No heartbeat from core client for 30 sec - exiting 00:43:56 (5712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4932, iMonCtr=1 Model crash detected, will try to restart... 22:02:58 (1508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 22:42:58 (4744): No heartbeat from core client for 30 sec - exiting 22:43:00 (4744): No heartbeat from core client for 30 sec - exiting 22:43:01 (4744): No heartbeat from core client for 30 sec - exiting 22:43:02 (4744): No heartbeat from core client for 30 sec - exiting 22:43:03 (4744): No heartbeat from core client for 30 sec - exiting 22:43:04 (4744): No heartbeat from core client for 30 sec - exiting 22:43:05 (4744): No heartbeat from core client for 30 sec - exiting 22:43:06 (4744): No heartbeat from core client for 30 sec - exiting 22:43:08 (4744): No heartbeat from core client for 30 sec - exiting 22:43:09 (4744): No heartbeat from core client for 30 sec - exiting 22:43:10 (4744): No heartbeat from core client for 30 sec - exiting 22:43:11 (4744): No heartbeat from core client for 30 sec - exiting 22:43:12 (4744): No heartbeat from core client for 30 sec - exiting 22:43:13 (4744): No heartbeat from core client for 30 sec - exiting 22:43:14 (4744): No heartbeat from core client for 30 sec - exiting 22:43:15 (4744): No heartbeat from core client for 30 sec - exiting 22:43:16 (4744): No heartbeat from core client for 30 sec - exiting 22:43:17 (4744): No heartbeat from core client for 30 sec - exiting 22:43:18 (4744): No heartbeat from core client for 30 sec - exiting 22:43:20 (4744): No heartbeat from core client for 30 sec - exiting 22:43:21 (4744): No heartbeat from core client for 30 sec - exiting 22:43:22 (4744): No heartbeat from core client for 30 sec - exiting 22:43:23 (4744): No heartbeat from core client for 30 sec - exiting 22:43:24 (4744): No heartbeat from core client for 30 sec - exiting 22:43:25 (4744): No heartbeat from core client for 30 sec - exiting 22:43:26 (4744): No heartbeat from core client for 30 sec - exiting 22:43:27 (4744): No heartbeat from core client for 30 sec - exiting 22:43:28 (4744): No heartbeat from core client for 30 sec - exiting 22:43:29 (4744): No heartbeat from core client for 30 sec - exiting 22:43:30 (4744): No heartbeat from core client for 30 sec - exiting 22:43:32 (4744): No heartbeat from core client for 30 sec - exiting 22:43:33 (4744): No heartbeat from core client for 30 sec - exiting 22:43:34 (4744): No heartbeat from core client for 30 sec - exiting 22:43:35 (4744): No heartbeat from core client for 30 sec - exiting 22:43:36 (4744): No heartbeat from core client for 30 sec - exiting 22:43:37 (4744): No heartbeat from core client for 30 sec - exiting 22:43:38 (4744): No heartbeat from core client for 30 sec - exiting 22:43:39 (4744): No heartbeat from core client for 30 sec - exiting 22:43:40 (4744): No heartbeat from core client for 30 sec - exiting 22:43:41 (4744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 00:17:55 (2884): No heartbeat from core client for 30 sec - exiting 00:17:56 (2884): No heartbeat from core client for 30 sec - exiting 00:17:57 (2884): No heartbeat from core client for 30 sec - exiting 00:17:58 (2884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 21:39:07 (5104): No heartbeat from core client for 30 sec - exiting 21:39:08 (5104): No heartbeat from core client for 30 sec - exiting 21:39:09 (5104): No heartbeat from core client for 30 sec - exiting 21:39:10 (5104): No heartbeat from core client for 30 sec - exiting 21:39:11 (5104): No heartbeat from core client for 30 sec - exiting 21:39:12 (5104): No heartbeat from core client for 30 sec - exiting 21:39:13 (5104): No heartbeat from core client for 30 sec - exiting 21:39:14 (5104): No heartbeat from core client for 30 sec - exiting 21:39:16 (5104): No heartbeat from core client for 30 sec - exiting 21:39:17 (5104): No heartbeat from core client for 30 sec - exiting 21:39:18 (5104): No heartbeat from core client for 30 sec - exiting 21:39:19 (5104): No heartbeat from core client for 30 sec - exiting 21:39:20 (5104): No heartbeat from core client for 30 sec - exiting 21:39:21 (5104): No heartbeat from core client for 30 sec - exiting 21:39:22 (5104): No heartbeat from core client for 30 sec - exiting 21:39:23 (5104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:40:39 (3684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7068, iMonCtr=1 Model crash detected, will try to restart... 00:11:58 (4492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:13:25 (6348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:23:27 (1536): No heartbeat from core client for 30 sec - exiting 14:23:28 (1536): No heartbeat from core client for 30 sec - exiting 14:23:29 (1536): No heartbeat from core client for 30 sec - exiting 14:23:30 (1536): No heartbeat from core client for 30 sec - exiting 14:23:31 (1536): No heartbeat from core client for 30 sec - exiting 14:23:32 (1536): No heartbeat from core client for 30 sec - exiting 14:23:34 (1536): No heartbeat from core client for 30 sec - exiting 14:23:35 (1536): No heartbeat from core client for 30 sec - exiting 14:23:36 (1536): No heartbeat from core client for 30 sec - exiting 14:23:37 (1536): No heartbeat from core client for 30 sec - exiting 14:23:38 (1536): No heartbeat from core client for 30 sec - exiting 14:23:39 (1536): No heartbeat from core client for 30 sec - exiting 14:23:40 (1536): No heartbeat from core client for 30 sec - exiting 14:23:41 (1536): No heartbeat from core client for 30 sec - exiting 14:23:42 (1536): No heartbeat from core client for 30 sec - exiting 14:23:43 (1536): No heartbeat from core client for 30 sec - exiting 14:23:44 (1536): No heartbeat from core client for 30 sec - exiting 14:23:45 (1536): No heartbeat from core client for 30 sec - exiting 14:23:47 (1536): No heartbeat from core client for 30 sec - exiting 14:23:48 (1536): No heartbeat from core client for 30 sec - exiting 14:23:49 (1536): No heartbeat from core client for 30 sec - exiting 14:23:50 (1536): No heartbeat from core client for 30 sec - exiting 14:23:51 (1536): No heartbeat from core client for 30 sec - exiting 14:23:52 (1536): No heartbeat from core client for 30 sec - exiting 14:23:53 (1536): No heartbeat from core client for 30 sec - exiting 14:23:54 (1536): No heartbeat from core client for 30 sec - exiting 14:23:55 (1536): No heartbeat from core client for 30 sec - exiting 14:23:56 (1536): No heartbeat from core client for 30 sec - exiting 14:23:57 (1536): No heartbeat from core client for 30 sec - exiting 14:23:59 (1536): No heartbeat from core client for 30 sec - exiting 14:24:00 (1536): No heartbeat from core client for 30 sec - exiting 14:24:01 (1536): No heartbeat from core client for 30 sec - exiting 14:24:02 (1536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6608, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
05 Aug 2011 05:13:45	1158195	13103802	hadcm3n_yd79_1900_40_007349967_1	259,200	909,236	3.5079
02 Aug 2011 13:15:03	1158195	13103802	hadcm3n_yd79_1900_40_007349967_1	233,280	819,489	3.5129
31 Jul 2011 01:14:02	1158195	13103802	hadcm3n_yd79_1900_40_007349967_1	207,360	730,250	3.5217
28 Jul 2011 02:48:48	1158195	13103802	hadcm3n_yd79_1900_40_007349967_1	181,440	636,529	3.5082
26 Jul 2011 23:41:47	1158195	13103802	hadcm3n_yd79_1900_40_007349967_1	155,520	544,473	3.5010
25 Jul 2011 23:58:21	1158195	13103802	hadcm3n_yd79_1900_40_007349967_1	129,600	455,089	3.5115
25 Jul 2011 22:12:55	1158195	13103802	hadcm3n_yd79_1900_40_007349967_1	103,680	363,622	3.5072
25 Jul 2011 20:49:23	1158195	13103802	hadcm3n_yd79_1900_40_007349967_1	77,760	272,810	3.5084
25 Jul 2011 19:31:17	1158195	13103802	hadcm3n_yd79_1900_40_007349967_1	51,840	183,488	3.5395
25 Jul 2011 19:23:54	1158195	13103802	hadcm3n_yd79_1900_40_007349967_1	25,920	90,227	3.4810