Task 16289694

Name	hadcm3n_ocij_1900_40_008471342_2
Workunit	8622181
Created	10 Feb 2014, 18:59:16 UTC
Sent	10 Feb 2014, 18:59:34 UTC
Report deadline	13 May 2014, 2:26:45 UTC
Received	24 Feb 2014, 17:00:10 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	25 (0x00000019) Unknown error code
Computer ID	1309218
Run time	3 days 0 hours 7 min 53 sec
CPU time	2 days 20 hours 31 min 3 sec
Validate state	Invalid
Credit	3,732.48
Device peak FLOPS	3.89 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> The drive cannot locate a specific area or track on the disk. (0x19) - exit code 25 (0x19) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4956, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5396, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5396, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:41:15 (1692): No heartbeat from core client for 30 sec - exiting 08:41:16 (1692): No heartbeat from core client for 30 sec - exiting 08:41:17 (1692): No heartbeat from core client for 30 sec - exiting 08:41:18 (1692): No heartbeat from core client for 30 sec - exiting 08:41:19 (1692): No heartbeat from core client for 30 sec - exiting 08:41:20 (1692): No heartbeat from core client for 30 sec - exiting 08:41:21 (1692): No heartbeat from core client for 30 sec - exiting 08:41:22 (1692): No heartbeat from core client for 30 sec - exiting 08:41:23 (1692): No heartbeat from core client for 30 sec - exiting 08:41:24 (1692): No heartbeat from core client for 30 sec - exiting 08:41:25 (1692): No heartbeat from core client for 30 sec - exiting 08:41:26 (1692): No heartbeat from core client for 30 sec - exiting 08:41:27 (1692): No heartbeat from core client for 30 sec - exiting 08:41:28 (1692): No heartbeat from core client for 30 sec - exiting 08:41:29 (1692): No heartbeat from core client for 30 sec - exiting 08:41:30 (1692): No heartbeat from core client for 30 sec - exiting 08:41:31 (1692): No heartbeat from core client for 30 sec - exiting 08:41:32 (1692): No heartbeat from core client for 30 sec - exiting 08:41:33 (1692): No heartbeat from core client for 30 sec - exiting 08:41:34 (1692): No heartbeat from core client for 30 sec - exiting 08:41:35 (1692): No heartbeat from core client for 30 sec - exiting 08:41:36 (1692): No heartbeat from core client for 30 sec - exiting 08:41:37 (1692): No heartbeat from core client for 30 sec - exiting 08:41:38 (1692): No heartbeat from core client for 30 sec - exiting 08:41:39 (1692): No heartbeat from core client for 30 sec - exiting 08:41:40 (1692): No heartbeat from core client for 30 sec - exiting 08:41:41 (1692): No heartbeat from core client for 30 sec - exiting 08:41:42 (1692): No heartbeat from core client for 30 sec - exiting 08:41:43 (1692): No heartbeat from core client for 30 sec - exiting 08:41:44 (1692): No heartbeat from core client for 30 sec - exiting 08:41:45 (1692): No heartbeat from core client for 30 sec - exiting 08:41:46 (1692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:50:14 (5464): No heartbeat from core client for 30 sec - exiting 08:50:15 (5464): No heartbeat from core client for 30 sec - exiting 08:50:16 (5464): No heartbeat from core client for 30 sec - exiting 08:50:17 (5464): No heartbeat from core client for 30 sec - exiting 08:50:18 (5464): No heartbeat from core client for 30 sec - exiting 08:50:19 (5464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4596, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6548, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6548, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6548, iMonCtr=1 Model crash detected, will try to restart... 10:17:47 (3240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Feb 2014 10:56:04	1309218	16289694	hadcm3n_ocij_1900_40_008471342_2	311,040	237,849	0.7647
23 Feb 2014 05:10:26	1309218	16289694	hadcm3n_ocij_1900_40_008471342_2	285,120	218,006	0.7646
23 Feb 2014 00:09:50	1309218	16289694	hadcm3n_ocij_1900_40_008471342_2	259,200	198,381	0.7654
22 Feb 2014 19:03:55	1309218	16289694	hadcm3n_ocij_1900_40_008471342_2	233,280	180,507	0.7738
19 Feb 2014 22:55:17	1309218	16289694	hadcm3n_ocij_1900_40_008471342_2	207,360	162,317	0.7828
19 Feb 2014 17:43:53	1309218	16289694	hadcm3n_ocij_1900_40_008471342_2	181,440	142,540	0.7856
18 Feb 2014 12:59:01	1309218	16289694	hadcm3n_ocij_1900_40_008471342_2	155,520	123,392	0.7934
15 Feb 2014 02:00:49	1309218	16289694	hadcm3n_ocij_1900_40_008471342_2	129,600	102,917	0.7941
14 Feb 2014 20:09:42	1309218	16289694	hadcm3n_ocij_1900_40_008471342_2	103,680	82,394	0.7947
14 Feb 2014 14:17:05	1309218	16289694	hadcm3n_ocij_1900_40_008471342_2	77,760	62,118	0.7988
14 Feb 2014 03:19:59	1309218	16289694	hadcm3n_ocij_1900_40_008471342_2	51,840	39,959	0.7708
11 Feb 2014 01:24:37	1309218	16289694	hadcm3n_ocij_1900_40_008471342_2	25,920	19,838	0.7654