Task 15914488

Name	hadcm3n_4hm6_1940_40_008308602_3
Workunit	8459737
Created	14 Aug 2013, 11:38:56 UTC
Sent	15 Aug 2013, 4:47:47 UTC
Report deadline	14 Nov 2013, 12:14:58 UTC
Received	4 Sep 2013, 7:11:29 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	957393
Run time	9 days 0 hours 9 min 2 sec
CPU time	7 days 7 hours 17 min 2 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.71 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> (unknown error) - exit code 193 (0xc1) </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4620, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4620, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4620, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4620, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4620, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:34:00 (268): No heartbeat from core client for 30 sec - exiting 22:34:01 (268): No heartbeat from core client for 30 sec - exiting 22:34:02 (268): No heartbeat from core client for 30 sec - exiting 22:34:03 (268): No heartbeat from core client for 30 sec - exiting 22:34:04 (268): No heartbeat from core client for 30 sec - exiting 22:34:05 (268): No heartbeat from core client for 30 sec - exiting 22:34:06 (268): No heartbeat from core client for 30 sec - exiting 22:34:07 (268): No heartbeat from core client for 30 sec - exiting 22:34:08 (268): No heartbeat from core client for 30 sec - exiting 22:34:09 (268): No heartbeat from core client for 30 sec - exiting 22:34:10 (268): No heartbeat from core client for 30 sec - exiting 22:34:11 (268): No heartbeat from core client for 30 sec - exiting 22:34:12 (268): No heartbeat from core client for 30 sec - exiting 22:34:13 (268): No heartbeat from core client for 30 sec - exiting 22:34:14 (268): No heartbeat from core client for 30 sec - exiting 22:34:15 (268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:34:16 (268): No heartbeat from core client for 30 sec - exiting 22:34:17 (268): No heartbeat from core client for 30 sec - exiting 22:34:18 (268): No heartbeat from core client for 30 sec - exiting 22:34:52 (3548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:35:52 (3640): Can't acquire lockfile (32) - waiting 35s 22:36:02 (2456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/4hm6ko.pje9c10 Error converting file to netcdf: dataout/4hm6ko.pie9c10 Error converting file to netcdf: dataout/4hm6ko.pfe9c10 Error converting file to netcdf: dataout/4hm6ka.phe9c10 Error converting file to netcdf: dataout/4hm6ka.pge9c10 Error converting file to netcdf: dataout/4hm6ka.pee9c10 Error converting file to netcdf: dataout/4hm6ka.pde9c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
04 Sep 2013 06:15:38	957393	15914488	hadcm3n_4hm6_1940_40_008308602_3	259,200	631,002	2.4344
02 Sep 2013 13:16:06	957393	15914488	hadcm3n_4hm6_1940_40_008308602_3	233,280	566,443	2.4282
30 Aug 2013 15:44:10	957393	15914488	hadcm3n_4hm6_1940_40_008308602_3	207,360	503,075	2.4261
29 Aug 2013 15:13:00	957393	15914488	hadcm3n_4hm6_1940_40_008308602_3	181,440	440,210	2.4262
27 Aug 2013 18:18:49	957393	15914488	hadcm3n_4hm6_1940_40_008308602_3	155,520	378,060	2.4309
26 Aug 2013 13:05:18	957393	15914488	hadcm3n_4hm6_1940_40_008308602_3	129,600	314,570	2.4272
20 Aug 2013 14:19:21	957393	15914488	hadcm3n_4hm6_1940_40_008308602_3	103,680	251,920	2.4298
19 Aug 2013 17:21:35	957393	15914488	hadcm3n_4hm6_1940_40_008308602_3	77,760	189,743	2.4401
18 Aug 2013 20:17:01	957393	15914488	hadcm3n_4hm6_1940_40_008308602_3	51,840	127,509	2.4597
17 Aug 2013 23:47:39	957393	15914488	hadcm3n_4hm6_1940_40_008308602_3	25,920	65,200	2.5154