Task 15498236

Name	hadcm3n_3jyx_1940_40_008268386_0
Workunit	8423510
Created	21 Dec 2012, 23:07:09 UTC
Sent	21 Dec 2012, 23:22:33 UTC
Report deadline	23 Mar 2013, 6:49:44 UTC
Received	23 Apr 2013, 20:58:29 UTC
Server state	Over
Outcome	Computation error
Client state	Aborted by user
Exit status	203 (0x000000CB) EXIT_ABORTED_VIA_GUI
Computer ID	1258733
Run time	22 days 17 hours 9 min 36 sec
CPU time	19 days 7 hours 10 min 2 sec
Validate state	Invalid
Credit	7,153.92
Device peak FLOPS	1.40 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> aborted by user </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1100, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4640, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4240, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5528, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4668, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3452, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2384, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=796, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2864, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5108, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4216, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4444, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6784, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4248, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=312, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4900, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4900, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4724, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4780, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5000, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1764, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4900, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4644, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4744, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1632, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/3jyxko.pjf6c10 Error converting file to netcdf: dataout/3jyxko.pif6c10 Error converting file to netcdf: dataout/3jyxko.pff6c10 Error converting file to netcdf: dataout/3jyxka.phf6c10 Error converting file to netcdf: dataout/3jyxka.pgf6c10 Error converting file to netcdf: dataout/3jyxka.pef6c10 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4444, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4120, iMonCtr=1 Model crash detected, will try to restart... 05:21:57 (4196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4896, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4996, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4964, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5376, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4676, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4240, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Abort request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
22 Apr 2013 21:35:03	1258733	15498236	hadcm3n_3jyx_1940_40_008268386_0	596,160	1,659,118	2.7830
18 Apr 2013 08:56:20	1258733	15498236	hadcm3n_3jyx_1940_40_008268386_0	570,240	1,587,706	2.7843
17 Apr 2013 11:42:56	1258733	15498236	hadcm3n_3jyx_1940_40_008268386_0	544,320	1,517,046	2.7870
16 Apr 2013 15:00:47	1258733	15498236	hadcm3n_3jyx_1940_40_008268386_0	518,400	1,446,311	2.7900
15 Apr 2013 18:05:12	1258733	15498236	hadcm3n_3jyx_1940_40_008268386_0	492,480	1,375,921	2.7939
10 Apr 2013 01:00:20	1258733	15498236	hadcm3n_3jyx_1940_40_008268386_0	466,560	1,305,221	2.7975
08 Apr 2013 07:21:36	1258733	15498236	hadcm3n_3jyx_1940_40_008268386_0	440,640	1,232,881	2.7979
07 Apr 2013 09:28:07	1258733	15498236	hadcm3n_3jyx_1940_40_008268386_0	414,720	1,160,820	2.7990
29 Mar 2013 12:57:29	1258733	15498236	hadcm3n_3jyx_1940_40_008268386_0	388,800	1,087,980	2.7983
25 Mar 2013 16:11:42	1258733	15498236	hadcm3n_3jyx_1940_40_008268386_0	362,880	1,016,015	2.7999
21 Mar 2013 09:14:22	1258733	15498236	hadcm3n_3jyx_1940_40_008268386_0	336,960	942,713	2.7977
18 Mar 2013 21:41:02	1258733	15498236	hadcm3n_3jyx_1940_40_008268386_0	311,040	870,916	2.8000
15 Mar 2013 16:35:45	1258733	15498236	hadcm3n_3jyx_1940_40_008268386_0	285,120	798,191	2.7995
13 Mar 2013 13:20:06	1258733	15498236	hadcm3n_3jyx_1940_40_008268386_0	259,200	725,881	2.8005
09 Mar 2013 20:42:26	1258733	15498236	hadcm3n_3jyx_1940_40_008268386_0	233,280	652,495	2.7970
08 Mar 2013 10:57:14	1258733	15498236	hadcm3n_3jyx_1940_40_008268386_0	207,360	580,543	2.7997
06 Mar 2013 15:50:38	1258733	15498236	hadcm3n_3jyx_1940_40_008268386_0	181,440	509,176	2.8063
04 Mar 2013 16:20:49	1258733	15498236	hadcm3n_3jyx_1940_40_008268386_0	155,520	437,479	2.8130
02 Mar 2013 11:59:29	1258733	15498236	hadcm3n_3jyx_1940_40_008268386_0	129,600	364,467	2.8122
26 Feb 2013 21:33:29	1258733	15498236	hadcm3n_3jyx_1940_40_008268386_0	103,680	291,570	2.8122