Task 13678710

Name	hadcm3n_u7d1_1980_40_007548600_0
Workunit	7745832
Created	30 Nov 2011, 22:56:20 UTC
Sent	30 Nov 2011, 23:11:15 UTC
Report deadline	1 Mar 2012, 6:38:26 UTC
Received	6 Jan 2012, 20:37:12 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	25 (0x00000019) Unknown error code
Computer ID	1066486
Run time	12 days 2 hours 53 min 32 sec
CPU time	11 days 19 hours 6 min 25 sec
Validate state	Invalid
Credit	7,464.96
Device peak FLOPS	3.02 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> The drive cannot locate a specific area or track on the disk. (0x19) - exit code 25 (0x19) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:22:16 (4080): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 11:22:17 (4080): No heartbeat from core client for 30 sec - exiting 11:22:18 (4080): No heartbeat from core client for 30 sec - exiting 11:22:19 (4080): No heartbeat from core client for 30 sec - exiting 11:22:20 (4080): No heartbeat from core client for 30 sec - exiting 11:22:21 (4080): No heartbeat from core client for 30 sec - exiting 11:22:22 (4080): No heartbeat from core client for 30 sec - exiting 11:22:23 (4080): No heartbeat from core client for 30 sec - exiting 11:22:24 (4080): No heartbeat from core client for 30 sec - exiting 11:22:25 (4080): No heartbeat from core client for 30 sec - exiting 11:22:26 (4080): No heartbeat from core client for 30 sec - exiting 11:22:27 (4080): No heartbeat from core client for 30 sec - exiting 11:22:28 (4080): No heartbeat from core client for 30 sec - exiting BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3188, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3188, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3188, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3188, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3188, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3188, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
04 Jan 2012 18:49:37	1066486	13678710	hadcm3n_u7d1_1980_40_007548600_0	622,080	855,850	1.3758
04 Jan 2012 08:46:12	1066486	13678710	hadcm3n_u7d1_1980_40_007548600_0	596,160	821,635	1.3782
03 Jan 2012 21:07:39	1066486	13678710	hadcm3n_u7d1_1980_40_007548600_0	570,240	786,934	1.3800
03 Jan 2012 01:44:34	1066486	13678710	hadcm3n_u7d1_1980_40_007548600_0	544,320	751,865	1.3813
02 Jan 2012 10:20:09	1066486	13678710	hadcm3n_u7d1_1980_40_007548600_0	518,400	717,065	1.3832
01 Jan 2012 21:06:48	1066486	13678710	hadcm3n_u7d1_1980_40_007548600_0	492,480	682,340	1.3855
01 Jan 2012 06:46:57	1066486	13678710	hadcm3n_u7d1_1980_40_007548600_0	466,560	647,314	1.3874
31 Dec 2011 16:23:08	1066486	13678710	hadcm3n_u7d1_1980_40_007548600_0	440,640	612,386	1.3898
31 Dec 2011 00:39:14	1066486	13678710	hadcm3n_u7d1_1980_40_007548600_0	414,720	577,651	1.3929
30 Dec 2011 10:11:28	1066486	13678710	hadcm3n_u7d1_1980_40_007548600_0	388,800	542,721	1.3959
29 Dec 2011 19:13:58	1066486	13678710	hadcm3n_u7d1_1980_40_007548600_0	362,880	507,641	1.3989
29 Dec 2011 03:32:25	1066486	13678710	hadcm3n_u7d1_1980_40_007548600_0	336,960	473,030	1.4038
28 Dec 2011 14:11:06	1066486	13678710	hadcm3n_u7d1_1980_40_007548600_0	311,040	438,082	1.4084
27 Dec 2011 23:27:31	1066486	13678710	hadcm3n_u7d1_1980_40_007548600_0	285,120	403,217	1.4142
27 Dec 2011 06:32:04	1066486	13678710	hadcm3n_u7d1_1980_40_007548600_0	259,200	368,275	1.4208
26 Dec 2011 16:26:36	1066486	13678710	hadcm3n_u7d1_1980_40_007548600_0	233,280	333,529	1.4297
26 Dec 2011 01:18:42	1066486	13678710	hadcm3n_u7d1_1980_40_007548600_0	207,360	299,099	1.4424
19 Dec 2011 14:39:04	1066486	13678710	hadcm3n_u7d1_1980_40_007548600_0	181,440	263,271	1.4510
10 Dec 2011 09:56:19	1066486	13678710	hadcm3n_u7d1_1980_40_007548600_0	155,520	228,230	1.4675
09 Dec 2011 19:27:09	1066486	13678710	hadcm3n_u7d1_1980_40_007548600_0	129,600	190,002	1.4661