Task 15784078

Name	hadcm3n_49r8_1980_40_008361343_1
Workunit	8512202
Created	14 May 2013, 16:57:08 UTC
Sent	14 May 2013, 16:57:39 UTC
Report deadline	14 Aug 2013, 0:24:50 UTC
Received	2 Mar 2014, 6:42:47 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	25 (0x00000019) Unknown error code
Computer ID	1172209
Run time	37 days 15 hours 29 min 10 sec
CPU time	28 days 15 hours 20 min 28 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	1.84 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.39</core_client_version> <![CDATA[ <message> The drive cannot locate a specific area or track on the disk. (0x19) - exit code 25 (0x19) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:37:29 (5392): No heartbeat from core client for 30 sec - exiting 14:37:30 (5392): No heartbeat from core client for 30 sec - exiting 14:37:31 (5392): No heartbeat from core client for 30 sec - exiting 14:37:32 (5392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5076, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5076, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5076, iMonCtr=1 Model crash detected, will try to restart... 15:09:51 (6788): No heartbeat from core client for 30 sec - exiting 15:09:52 (6788): No heartbeat from core client for 30 sec - exiting 15:09:53 (6788): No heartbeat from core client for 30 sec - exiting 15:09:54 (6788): No heartbeat from core client for 30 sec - exiting 15:09:55 (6788): No heartbeat from core client for 30 sec - exiting 15:09:56 (6788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:09:57 (6788): No heartbeat from core client for 30 sec - exiting 15:14:51 (7052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:01:05 (4456): No heartbeat from core client for 30 sec - exiting 18:01:07 (4456): No heartbeat from core client for 30 sec - exiting 18:01:08 (4456): No heartbeat from core client for 30 sec - exiting 18:01:09 (4456): No heartbeat from core client for 30 sec - exiting 18:01:10 (4456): No heartbeat from core client for 30 sec - exiting 18:01:11 (4456): No heartbeat from core client for 30 sec - exiting 18:01:12 (4456): No heartbeat from core client for 30 sec - exiting 18:01:13 (4456): No heartbeat from core client for 30 sec - exiting 18:01:14 (4456): No heartbeat from core client for 30 sec - exiting 18:01:15 (4456): No heartbeat from core client for 30 sec - exiting 18:01:16 (4456): No heartbeat from core client for 30 sec - exiting 18:01:17 (4456): No heartbeat from core client for 30 sec - exiting 18:01:18 (4456): No heartbeat from core client for 30 sec - exiting 18:01:19 (4456): No heartbeat from core client for 30 sec - exiting 18:01:20 (4456): No heartbeat from core client for 30 sec - exiting 18:01:21 (4456): No heartbeat from core client for 30 sec - exiting 18:01:22 (4456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:27:17 (5792): No heartbeat from core client for 30 sec - exiting 12:27:18 (5792): No heartbeat from core client for 30 sec - exiting 12:27:19 (5792): No heartbeat from core client for 30 sec - exiting 12:27:20 (5792): No heartbeat from core client for 30 sec - exiting 12:27:21 (5792): No heartbeat from core client for 30 sec - exiting 12:27:22 (5792): No heartbeat from core client for 30 sec - exiting 12:27:23 (5792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 13:27:29 (3596): No heartbeat from core client for 30 sec - exiting 13:27:30 (3596): No heartbeat from core client for 30 sec - exiting 13:27:31 (3596): No heartbeat from core client for 30 sec - exiting 13:27:32 (3596): No heartbeat from core client for 30 sec - exiting 13:27:33 (3596): No heartbeat from core client for 30 sec - exiting 13:27:34 (3596): No heartbeat from core client for 30 sec - exiting 13:27:35 (3596): No heartbeat from core client for 30 sec - exiting 13:27:36 (3596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:27:37 (3596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:49:08 (4464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:26:54 (380): No heartbeat from core client for 30 sec - exiting 00:26:55 (380): No heartbeat from core client for 30 sec - exiting 00:26:56 (380): No heartbeat from core client for 30 sec - exiting 00:26:57 (380): No heartbeat from core client for 30 sec - exiting 00:26:58 (380): No heartbeat from core client for 30 sec - exiting 00:26:59 (380): No heartbeat from core client for 30 sec - exiting 00:27:00 (380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:27:01 (380): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6676, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6012, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3176, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1128, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... C12:55:43 (6624): No heartbeat from core client for 30 sec - exiting 12:55:44 (6624): No heartbeat from core client for 30 sec - exiting 12:55:45 (6624): No heartbeat from core client for 30 sec - exiting 12:55:46 (6624): No heartbeat from core client for 30 sec - exiting 12:55:47 (6624): No heartbeat from core client for 30 sec - exiting 12:55:48 (6624): No heartbeat from core client for 30 sec - exiting 12:55:49 (6624): No heartbeat from core client for 30 sec - exiting 12:55:50 (6624): No heartbeat from core client for 30 sec - exiting 12:55:51 (6624): No heartbeat from core client for 30 sec - exiting 12:55:52 (6624): No heartbeat from core client for 30 sec - exiting 12:55:53 (6624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:55:54 (6624): No heartbeat from core client for 30 sec - exiting 12:55:55 (6624): No heartbeat from core client for 30 sec - exiting 12:55:57 (6624): No heartbeat from core client for 30 sec - exiting 12:55:58 (6624): No heartbeat from core client for 30 sec - exiting 12:55:59 (6624): No heartbeat from core client for 30 sec - exiting 12:56:00 (6624): No heartbeat from core client for 30 sec - exiting 12:56:01 (6624): No heartbeat from core client for 30 sec - exiting 12:56:02 (6624): No heartbeat from core client for 30 sec - exiting 12:56:04 (6624): No heartbeat from core client for 30 sec - exiting 12:56:05 (6624): No heartbeat from core client for 30 sec - exiting 12:56:06 (6624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 11:07:51 (5528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:29:58 (6640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:40:00 (4560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:29:19 (2660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:45:30 (4992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:45:31 (4992): No heartbeat from core client for 30 sec - exiting 14:26:46 (6212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:47:21 (4888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:47:22 (4888): No heartbeat from core client for 30 sec - exiting 14:49:00 (5948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 03:55:44 (6128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:55:45 (6128): No heartbeat from core client for 30 sec - exiting 03:55:46 (6128): No heartbeat from core client for 30 sec - exiting 03:55:47 (6128): No heartbeat from core client for 30 sec - exiting 03:55:48 (6128): No heartbeat from core client for 30 sec - exiting 03:55:49 (6128): No heartbeat from core client for 30 sec - exiting 03:55:50 (6128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5376, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 21:09:47 (5544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:40:50 (4204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:10:14 (6080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=62816, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 05:09:48 (8172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:09:49 (8172): No heartbeat from core client for 30 sec - exiting 05:09:50 (8172): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
28 Feb 2014 01:25:05	1172209	15784078	hadcm3n_49r8_1980_40_008361343_1	777,600	2,421,905	3.1146
25 Feb 2014 05:48:58	1172209	15784078	hadcm3n_49r8_1980_40_008361343_1	751,680	2,341,889	3.1155
18 Jan 2014 16:30:40	1172209	15784078	hadcm3n_49r8_1980_40_008361343_1	725,760	2,266,386	3.1228
17 Jan 2014 11:17:44	1172209	15784078	hadcm3n_49r8_1980_40_008361343_1	699,840	2,187,485	3.1257
09 Jan 2014 08:22:02	1172209	15784078	hadcm3n_49r8_1980_40_008361343_1	673,920	2,118,748	3.1439
08 Jan 2014 11:41:40	1172209	15784078	hadcm3n_49r8_1980_40_008361343_1	648,000	2,049,237	3.1624
05 Jan 2014 06:29:31	1172209	15784078	hadcm3n_49r8_1980_40_008361343_1	622,080	1,981,504	3.1853
04 Jan 2014 12:53:29	1172209	15784078	hadcm3n_49r8_1980_40_008361343_1	596,160	1,919,964	3.2206
03 Jan 2014 20:16:15	1172209	15784078	hadcm3n_49r8_1980_40_008361343_1	570,240	1,860,910	3.2634
03 Jan 2014 02:59:21	1172209	15784078	hadcm3n_49r8_1980_40_008361343_1	544,320	1,800,596	3.3080
31 Dec 2013 09:14:52	1172209	15784078	hadcm3n_49r8_1980_40_008361343_1	518,400	1,739,741	3.3560
30 Dec 2013 15:18:52	1172209	15784078	hadcm3n_49r8_1980_40_008361343_1	492,480	1,677,467	3.4062
29 Dec 2013 15:13:39	1172209	15784078	hadcm3n_49r8_1980_40_008361343_1	466,560	1,604,347	3.4387
27 Dec 2013 05:05:48	1172209	15784078	hadcm3n_49r8_1980_40_008361343_1	440,640	1,525,148	3.4612
02 Dec 2013 19:55:52	1172209	15784078	hadcm3n_49r8_1980_40_008361343_1	414,720	1,446,443	3.4878
01 Dec 2013 18:10:00	1172209	15784078	hadcm3n_49r8_1980_40_008361343_1	388,800	1,368,271	3.5192
30 Nov 2013 15:50:09	1172209	15784078	hadcm3n_49r8_1980_40_008361343_1	362,880	1,290,332	3.5558
29 Nov 2013 09:09:14	1172209	15784078	hadcm3n_49r8_1980_40_008361343_1	336,960	1,208,150	3.5854
08 Oct 2013 16:39:07	1172209	15784078	hadcm3n_49r8_1980_40_008361343_1	311,040	1,118,906	3.5973
28 Sep 2013 13:58:26	1172209	15784078	hadcm3n_49r8_1980_40_008361343_1	285,120	1,023,483	3.5897