Task 16586998

Name	hadcm3n_89uu_1980_40_008722193_0
Workunit	8868171
Created	23 Apr 2014, 12:44:51 UTC
Sent	4 May 2014, 17:14:43 UTC
Report deadline	4 Aug 2014, 0:41:54 UTC
Received	17 Jun 2014, 10:22:54 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	415805
Run time	11 days 21 hours 56 min 42 sec
CPU time	10 days 20 hours 39 min 49 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	3.16 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <message> (unknown error) - exit code 193 (0xc1) </message> <stderr_txt> CCPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3552, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5888, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/89uuko.pjj3c10 Error converting file to netcdf: dataout/89uuko.pij3c10 Error converting file to netcdf: dataout/89uuko.pfj3c10 Error converting file to netcdf: dataout/89uuka.phj3c10 Error converting file to netcdf: dataout/89uuka.pgj3c10 Error converting file to netcdf: dataout/89uuka.pej3c10 Error converting file to netcdf: dataout/89uuka.pdj3c10 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2872, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4576, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6096, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 20:06:06 (4872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3804, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4172, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5980, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4300, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:05:17 (4260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:46:54 (1240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
17 Jun 2014 09:11:05	415805	16586998	hadcm3n_89uu_1980_40_008722193_0	777,600	938,376	1.2068
15 Jun 2014 07:36:10	415805	16586998	hadcm3n_89uu_1980_40_008722193_0	751,680	908,079	1.2081
13 Jun 2014 11:42:07	415805	16586998	hadcm3n_89uu_1980_40_008722193_0	725,760	877,774	1.2095
11 Jun 2014 17:37:57	415805	16586998	hadcm3n_89uu_1980_40_008722193_0	699,840	845,807	1.2086
10 Jun 2014 14:10:09	415805	16586998	hadcm3n_89uu_1980_40_008722193_0	673,920	815,572	1.2102
10 Jun 2014 09:03:15	415805	16586998	hadcm3n_89uu_1980_40_008722193_0	648,000	784,892	1.2113
10 Jun 2014 09:00:41	415805	16586998	hadcm3n_89uu_1980_40_008722193_0	622,080	754,389	1.2127
06 Jun 2014 11:13:09	415805	16586998	hadcm3n_89uu_1980_40_008722193_0	596,160	722,522	1.2120
04 Jun 2014 18:17:37	415805	16586998	hadcm3n_89uu_1980_40_008722193_0	570,240	691,924	1.2134
03 Jun 2014 07:06:18	415805	16586998	hadcm3n_89uu_1980_40_008722193_0	544,320	659,546	1.2117
01 Jun 2014 13:54:53	415805	16586998	hadcm3n_89uu_1980_40_008722193_0	518,400	629,184	1.2137
30 May 2014 08:27:00	415805	16586998	hadcm3n_89uu_1980_40_008722193_0	492,480	598,027	1.2143
28 May 2014 17:44:37	415805	16586998	hadcm3n_89uu_1980_40_008722193_0	466,560	566,891	1.2150
27 May 2014 07:00:48	415805	16586998	hadcm3n_89uu_1980_40_008722193_0	440,640	534,117	1.2121
25 May 2014 11:52:05	415805	16586998	hadcm3n_89uu_1980_40_008722193_0	414,720	502,824	1.2124
24 May 2014 10:56:57	415805	16586998	hadcm3n_89uu_1980_40_008722193_0	388,800	472,757	1.2159
22 May 2014 14:07:40	415805	16586998	hadcm3n_89uu_1980_40_008722193_0	362,880	440,657	1.2143
21 May 2014 06:15:30	415805	16586998	hadcm3n_89uu_1980_40_008722193_0	336,960	407,706	1.2100
19 May 2014 14:34:39	415805	16586998	hadcm3n_89uu_1980_40_008722193_0	311,040	375,660	1.2078
18 May 2014 11:12:13	415805	16586998	hadcm3n_89uu_1980_40_008722193_0	285,120	345,121	1.2104