Task 14656026

Name	hadcm3n_1073_1940_40_007957628_2
Workunit	8112740
Created	10 May 2012, 22:44:18 UTC
Sent	10 May 2012, 22:48:51 UTC
Report deadline	10 Aug 2012, 6:16:02 UTC
Received	24 Jul 2012, 12:08:17 UTC
Server state	Over
Outcome	Computation error
Client state	Aborted by user
Exit status	-197 (0xFFFFFF3B) ERR_ABORTED_VIA_GUI
Computer ID	1305473
Run time	23 days 3 hours 25 min 39 sec
CPU time	18 days 11 hours 57 min 28 sec
Validate state	Invalid
Credit	6,842.88
Device peak FLOPS	3.56 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <message> aborted by user </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... 01:00:08 (12440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=11168, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=11140, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=11032, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 04:34:52 (13344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=19396, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=12032, iMonCtr=1 Model crash detected, will try to restart... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/1073ko.pjg2c10 Error converting file to netcdf: dataout/1073ko.pig2c10 Error converting file to netcdf: dataout/1073ko.pfg2c10 Error converting file to netcdf: dataout/1073ka.phg2c10 Error converting file to netcdf: dataout/1073ka.pgg2c10 Error converting file to netcdf: dataout/1073ka.peg2c10 Error converting file to netcdf: dataout/1073ka.pdg2c10 Ocean Restart file copy failed on 1073ko.dag2cl0 CPDN Monitor - Quit request from BOINC... 13:51:43 (11376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1244, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1244, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1244, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1244, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1244, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1244, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10352, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10352, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10352, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10352, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10612, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10612, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10612, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10612, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9768, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9768, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9768, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9768, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9752, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 02:10:47 (14424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 01:00:09 (11988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:00:15 (9800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Abort request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
31 May 2012 13:22:22	1192548	14656026	hadcm3n_1073_1940_40_007957628_2	570,240	959,798	1.6831
21 May 2012 23:00:08	1192548	14656026	hadcm3n_1073_1940_40_007957628_2	544,320	916,946	1.6846
21 May 2012 11:01:41	1192548	14656026	hadcm3n_1073_1940_40_007957628_2	518,400	872,611	1.6833
20 May 2012 22:35:09	1192548	14656026	hadcm3n_1073_1940_40_007957628_2	492,480	829,303	1.6839
20 May 2012 10:18:26	1192548	14656026	hadcm3n_1073_1940_40_007957628_2	466,560	784,539	1.6815
19 May 2012 21:51:35	1192548	14656026	hadcm3n_1073_1940_40_007957628_2	440,640	740,657	1.6809
19 May 2012 09:15:14	1192548	14656026	hadcm3n_1073_1940_40_007957628_2	414,720	696,695	1.6799
18 May 2012 20:49:32	1192548	14656026	hadcm3n_1073_1940_40_007957628_2	388,800	652,486	1.6782
18 May 2012 08:41:30	1192548	14656026	hadcm3n_1073_1940_40_007957628_2	362,880	609,045	1.6784
17 May 2012 21:00:52	1192548	14656026	hadcm3n_1073_1940_40_007957628_2	336,960	565,645	1.6787
17 May 2012 08:54:32	1192548	14656026	hadcm3n_1073_1940_40_007957628_2	311,040	522,178	1.6788
16 May 2012 20:11:44	1192548	14656026	hadcm3n_1073_1940_40_007957628_2	285,120	478,568	1.6785
16 May 2012 07:46:05	1192548	14656026	hadcm3n_1073_1940_40_007957628_2	259,200	434,690	1.6770
15 May 2012 20:07:27	1192548	14656026	hadcm3n_1073_1940_40_007957628_2	233,280	391,733	1.6792
15 May 2012 07:51:50	1192548	14656026	hadcm3n_1073_1940_40_007957628_2	207,360	348,171	1.6791
15 May 2012 00:48:56	1192548	14656026	hadcm3n_1073_1940_40_007957628_2	181,440	305,236	1.6823
14 May 2012 07:00:37	1192548	14656026	hadcm3n_1073_1940_40_007957628_2	155,520	262,353	1.6869
13 May 2012 18:36:53	1192548	14656026	hadcm3n_1073_1940_40_007957628_2	129,600	218,148	1.6832
13 May 2012 05:08:10	1192548	14656026	hadcm3n_1073_1940_40_007957628_2	103,680	175,506	1.6928
12 May 2012 16:52:20	1192548	14656026	hadcm3n_1073_1940_40_007957628_2	77,760	132,014	1.6977