Task 13813311

Name	hadcm3n_o2u4_1980_40_007547520_4
Workunit	7744752
Created	23 Dec 2011, 17:09:38 UTC
Sent	23 Dec 2011, 17:13:59 UTC
Report deadline	24 Mar 2012, 0:41:10 UTC
Received	12 Apr 2012, 0:12:01 UTC
Server state	Over
Outcome	Computation error
Client state	Aborted by user
Exit status	-197 (0xFFFFFF3B) ERR_ABORTED_VIA_GUI
Computer ID	1069319
Run time	66 days 11 hours 51 min 33 sec
CPU time	42 days 12 hours 7 min 34 sec
Validate state	Invalid
Credit	4,665.60
Device peak FLOPS	0.68 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.25</core_client_version> <![CDATA[ <message> aborted by user </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2552, iMonCtr=1 Model crash detected, will try to restart... 14:11:11 (4404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3588, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:07:58 (14000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4256, selfPID=4256, iMonCtr=1 BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o2u4ko.pji5c10 Error converting file to netcdf: dataout/o2u4ko.pii5c10 Error converting file to netcdf: dataout/o2u4ko.pfi5c10 Error converting file to netcdf: dataout/o2u4ka.phi5c10 Error converting file to netcdf: dataout/o2u4ka.pgi5c10 Error converting file to netcdf: dataout/o2u4ka.pei5c10 Error converting file to netcdf: dataout/o2u4ka.pdi5c10 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:34:17 (201776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:34:18 (201776): No heartbeat from core client for 30 sec - exiting 03:34:19 (201776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:20:31 (202540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:20:33 (202540): No heartbeat from core client for 30 sec - exiting 00:20:34 (202540): No heartbeat from core client for 30 sec - exiting 06:28:58 (202444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=199008, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 21:56:59 (2256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:39:49 (3028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:39:51 (3028): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 08:05:42 (6632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:40:06 (7924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:29:12 (4568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5644, iMonCtr=1 Model crash detected, will try to restart... 18:54:40 (2216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 10:58:12 (4484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:22:05 (5904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:25:48 (4700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:28:12 (5864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3916, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2068, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2068, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2068, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2068, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 21:57:43 (3648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:58:22 (6716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:58:23 (6716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 22:26:45 (6976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:20:16 (3276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:20:17 (3276): No heartbeat from core client for 30 sec - exiting 00:20:18 (3276): No heartbeat from core client for 30 sec - exiting 00:20:19 (3276): No heartbeat from core client for 30 sec - exiting 00:20:20 (3276): No heartbeat from core client for 30 sec - exiting 00:20:21 (3276): No heartbeat from core client for 30 sec - exiting 00:20:22 (3276): No heartbeat from core client for 30 sec - exiting 00:26:52 (332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:29:27 (2624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:29:28 (2624): No heartbeat from core client for 30 sec - exiting 00:42:04 (4936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:46:36 (7240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:52:22 (5172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:07:44 (7952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:20:14 (7228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:26:13 (6404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:14:09 (2972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:14:10 (2972): No heartbeat from core client for 30 sec - exiting 10:14:11 (2972): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:45:55 (14328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:45:56 (14328): No heartbeat from core client for 30 sec - exiting 21:49:06 (12644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 10:12:04 (3504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:12:05 (3504): No heartbeat from core client for 30 sec - exiting 10:12:06 (3504): No heartbeat from core client for 30 sec - exiting 10:12:07 (3504): No heartbeat from core client for 30 sec - exiting 10:12:08 (3504): No heartbeat from core client for 30 sec - exiting 10:12:09 (3504): No heartbeat from core client for 30 sec - exiting 10:12:11 (3504): No heartbeat from core client for 30 sec - exiting 10:12:12 (3504): No heartbeat from core client for 30 sec - exiting 10:12:13 (3504): No heartbeat from core client for 30 sec - exiting 10:12:14 (3504): No heartbeat from core client for 30 sec - exiting 10:12:15 (3504): No heartbeat from core client for 30 sec - exiting 10:12:16 (3504): No heartbeat from core client for 30 sec - exiting 10:12:17 (3504): No heartbeat from core client for 30 sec - exiting 10:12:18 (3504): No heartbeat from core client for 30 sec - exiting 10:12:19 (3504): No heartbeat from core client for 30 sec - exiting 10:12:20 (3504): No heartbeat from core client for 30 sec - exiting 10:12:21 (3504): No heartbeat from core client for 30 sec - exiting 10:12:23 (3504): No heartbeat from core client for 30 sec - exiting 10:12:24 (3504): No heartbeat from core client for 30 sec - exiting 10:12:25 (3504): No heartbeat from core client for 30 sec - exiting 10:12:26 (3504): No heartbeat from core client for 30 sec - exiting 10:12:27 (3504): No heartbeat from core client for 30 sec - exiting 10:12:28 (3504): No heartbeat from core client for 30 sec - exiting 10:12:29 (3504): No heartbeat from core client for 30 sec - exiting 10:12:30 (3504): No heartbeat from core client for 30 sec - exiting 10:12:31 (3504): No heartbeat from core client for 30 sec - exiting 10:12:32 (3504): No heartbeat from core client for 30 sec - exiting 10:12:34 (3504): No heartbeat from core client for 30 sec - exiting 10:12:35 (3504): No heartbeat from core client for 30 sec - exiting 10:12:36 (3504): No heartbeat from core client for 30 sec - exiting 10:12:37 (3504): No heartbeat from core client for 30 sec - exiting 10:12:38 (3504): No heartbeat from core client for 30 sec - exiting 10:12:39 (3504): No heartbeat from core client for 30 sec - exiting 10:12:40 (3504): No heartbeat from core client for 30 sec - exiting 10:12:41 (3504): No heartbeat from core client for 30 sec - exiting 10:12:42 (3504): No heartbeat from core client for 30 sec - exiting 10:12:43 (3504): No heartbeat from core client for 30 sec - exiting 10:12:45 (3504): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Abort request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
11 Mar 2012 05:26:21	1069319	13813311	hadcm3n_o2u4_1980_40_007547520_4	388,800	3,569,983	9.1821
03 Mar 2012 23:23:13	1069319	13813311	hadcm3n_o2u4_1980_40_007547520_4	362,880	3,329,275	9.1746
27 Feb 2012 20:35:37	1069319	13813311	hadcm3n_o2u4_1980_40_007547520_4	336,960	3,095,122	9.1854
23 Feb 2012 13:30:17	1069319	13813311	hadcm3n_o2u4_1980_40_007547520_4	311,040	2,865,738	9.2134
19 Feb 2012 02:04:11	1069319	13813311	hadcm3n_o2u4_1980_40_007547520_4	285,120	2,635,885	9.2448
11 Feb 2012 05:25:16	1069319	13813311	hadcm3n_o2u4_1980_40_007547520_4	259,200	2,408,769	9.2931
07 Feb 2012 01:54:05	1069319	13813311	hadcm3n_o2u4_1980_40_007547520_4	233,280	2,165,431	9.2825
03 Feb 2012 01:50:29	1069319	13813311	hadcm3n_o2u4_1980_40_007547520_4	207,360	1,920,351	9.2610
27 Jan 2012 06:55:47	1069319	13813311	hadcm3n_o2u4_1980_40_007547520_4	181,440	1,660,355	9.1510
23 Jan 2012 08:30:10	1069319	13813311	hadcm3n_o2u4_1980_40_007547520_4	155,520	1,411,840	9.0782
17 Jan 2012 09:18:15	1069319	13813311	hadcm3n_o2u4_1980_40_007547520_4	129,600	1,173,113	9.0518
11 Jan 2012 13:50:21	1069319	13813311	hadcm3n_o2u4_1980_40_007547520_4	103,680	940,844	9.0745
07 Jan 2012 02:15:53	1069319	13813311	hadcm3n_o2u4_1980_40_007547520_4	77,760	716,870	9.2190
03 Jan 2012 09:01:20	1069319	13813311	hadcm3n_o2u4_1980_40_007547520_4	51,840	477,491	9.2109
30 Dec 2011 14:02:35	1069319	13813311	hadcm3n_o2u4_1980_40_007547520_4	25,920	235,376	9.0809