Task 16650009

Name	hadcm3n_86ge_1980_40_008514869_1
Workunit	8662381
Created	29 May 2014, 0:38:05 UTC
Sent	29 May 2014, 0:38:13 UTC
Report deadline	28 Aug 2014, 8:05:24 UTC
Received	3 Mar 2015, 18:36:57 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1318247
Run time	13 days 17 hours 0 min 6 sec
CPU time	9 days 6 hours 11 min 59 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	1.24 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.4.36</core_client_version> <![CDATA[ <message> (unknown error) - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1836, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1836, iMonCtr=1 Model crash detected, will try to restart... 23:04:59 (620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:05:02 (620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3720, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3720, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3856, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2300, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 06:06:57 (3024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 01:09:18 (3520): No heartbeat from core client for 30 sec - exiting 01:09:20 (3520): No heartbeat from core client for 30 sec - exiting 01:09:21 (3520): No heartbeat from core client for 30 sec - exiting 01:09:22 (3520): No heartbeat from core client for 30 sec - exiting 01:09:23 (3520): No heartbeat from core client for 30 sec - exiting 01:09:24 (3520): No heartbeat from core client for 30 sec - exiting 01:09:25 (3520): No heartbeat from core client for 30 sec - exiting 01:09:26 (3520): No heartbeat from core client for 30 sec - exiting 01:09:27 (3520): No heartbeat from core client for 30 sec - exiting 01:09:28 (3520): No heartbeat from core client for 30 sec - exiting 01:09:29 (3520): No heartbeat from core client for 30 sec - exiting 01:09:31 (3520): No heartbeat from core client for 30 sec - exiting 01:09:32 (3520): No heartbeat from core client for 30 sec - exiting 01:09:33 (3520): No heartbeat from core client for 30 sec - exiting 01:09:34 (3520): No heartbeat from core client for 30 sec - exiting 01:09:35 (3520): No heartbeat from core client for 30 sec - exiting 01:09:36 (3520): No heartbeat from core client for 30 sec - exiting 01:09:37 (3520): No heartbeat from core client for 30 sec - exiting 01:09:38 (3520): No heartbeat from core client for 30 sec - exiting 01:09:39 (3520): No heartbeat from core client for 30 sec - exiting 01:09:40 (3520): No heartbeat from core client for 30 sec - exiting 01:09:42 (3520): No heartbeat from core client for 30 sec - exiting 01:09:43 (3520): No heartbeat from core client for 30 sec - exiting 01:09:44 (3520): No heartbeat from core client for 30 sec - exiting 01:09:45 (3520): No heartbeat from core client for 30 sec - exiting 01:09:46 (3520): No heartbeat from core client for 30 sec - exiting 01:09:47 (3520): No heartbeat from core client for 30 sec - exiting 01:09:48 (3520): No heartbeat from core client for 30 sec - exiting 01:09:49 (3520): No heartbeat from core client for 30 sec - exiting 01:09:50 (3520): No heartbeat from core client for 30 sec - exiting 01:09:51 (3520): No heartbeat from core client for 30 sec - exiting 01:09:52 (3520): No heartbeat from core client for 30 sec - exiting 01:09:54 (3520): No heartbeat from core client for 30 sec - exiting 01:09:55 (3520): No heartbeat from core client for 30 sec - exiting 01:09:56 (3520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:04:49 (3696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1468, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 00:05:07 (2748): No heartbeat from core client for 30 sec - exiting 00:05:09 (2748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:00:15 (2752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:00:16 (2752): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2836, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2436, iMonCtr=1 Model crash detected, will try to restart... 11:44:02 (3208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:39:17 (2224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:38:13 (3016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:38:15 (3016): No heartbeat from core client for 30 sec - exiting 05:00:14 (3328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=924, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:00:10 (1844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:57:48 (2776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:56:32 (3752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2844, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2844, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:59:42 (3020): No heartbeat from core client for 30 sec - exiting 21:59:43 (3020): No heartbeat from core client for 30 sec - exiting 21:59:44 (3020): No heartbeat from core client for 30 sec - exiting 21:59:45 (3020): No heartbeat from core client for 30 sec - exiting 21:59:46 (3020): No heartbeat from core client for 30 sec - exiting 21:59:48 (3020): No heartbeat from core client for 30 sec - exiting 21:59:49 (3020): No heartbeat from core client for 30 sec - exiting 21:59:50 (3020): No heartbeat from core client for 30 sec - exiting 21:59:51 (3020): No heartbeat from core client for 30 sec - exiting 21:59:52 (3020): No heartbeat from core client for 30 sec - exiting 21:59:53 (3020): No heartbeat from core client for 30 sec - exiting 21:59:54 (3020): No heartbeat from core client for 30 sec - exiting 21:59:55 (3020): No heartbeat from core client for 30 sec - exiting 21:59:56 (3020): No heartbeat from core client for 30 sec - exiting 21:59:57 (3020): No heartbeat from core client for 30 sec - exiting 21:59:59 (3020): No heartbeat from core client for 30 sec - exiting 22:00:00 (3020): No heartbeat from core client for 30 sec - exiting 22:00:01 (3020): No heartbeat from core client for 30 sec - exiting 22:00:02 (3020): No heartbeat from core client for 30 sec - exiting 22:00:03 (3020): No heartbeat from core client for 30 sec - exiting 22:00:04 (3020): No heartbeat from core client for 30 sec - exiting 22:00:05 (3020): No heartbeat from core client for 30 sec - exiting 22:00:06 (3020): No heartbeat from core client for 30 sec - exiting 22:00:07 (3020): No heartbeat from core client for 30 sec - exiting 22:00:08 (3020): No heartbeat from core client for 30 sec - exiting 22:00:09 (3020): No heartbeat from core client for 30 sec - exiting 22:00:11 (3020): No heartbeat from core client for 30 sec - exiting 22:00:12 (3020): No heartbeat from core client for 30 sec - exiting 22:00:13 (3020): No heartbeat from core client for 30 sec - exiting 22:00:14 (3020): No heartbeat from core client for 30 sec - exiting 22:00:15 (3020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:00:16 (3020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:08:27 (2932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:48:32 (1332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:49:27 (2852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:03:32 (3448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 08:12:53 (3604): No heartbeat from core client for 30 sec - exiting 08:12:54 (3604): No heartbeat from core client for 30 sec - exiting 08:12:55 (3604): No heartbeat from core client for 30 sec - exiting 08:12:57 (3604): No heartbeat from core client for 30 sec - exiting 08:12:58 (3604): No heartbeat from core client for 30 sec - exiting 08:12:59 (3604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:13:00 (3604): No heartbeat from core client for 30 sec - exiting 08:13:01 (3604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/86geko.pji9c10 Error converting file to netcdf: dataout/86geko.pii9c10 Error converting file to netcdf: dataout/86geko.pfi9c10 Error converting file to netcdf: dataout/86geka.phi9c10 Error converting file to netcdf: dataout/86geka.pgi9c10 Error converting file to netcdf: dataout/86geka.pei9c10 Error converting file to netcdf: dataout/86geka.pdi9c10 10:27:05 (3828): No heartbeat from core client for 30 sec - exiting 10:27:07 (3828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/86geko.pji9c10 Error converting file to netcdf: dataout/86geko.pii9c10 Error converting file to netcdf: dataout/86geko.pfi9c10 Error converting file to netcdf: dataout/86geka.phi9c10 Error converting file to netcdf: dataout/86geka.pgi9c10 Error converting file to netcdf: dataout/86geka.pei9c10 Error converting file to netcdf: dataout/86geka.pdi9c10 CPDN Monitor - Quit request from BOINC... 11:30:21 (1696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=644, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 09:10:57 (2728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=204, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:00:34 (3112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
03 Mar 2015 17:39:19	1318247	16650009	hadcm3n_86ge_1980_40_008514869_1	259,200	799,895	3.0860
28 Feb 2015 10:35:45	1318247	16650009	hadcm3n_86ge_1980_40_008514869_1	233,280	750,859	3.2187
23 Feb 2015 16:52:43	1318247	16650009	hadcm3n_86ge_1980_40_008514869_1	207,360	704,904	3.3994
05 Sep 2014 12:47:14	1318247	16650009	hadcm3n_86ge_1980_40_008514869_1	181,440	605,421	3.3368
05 Sep 2014 12:47:14	1318247	16650009	hadcm3n_86ge_1980_40_008514869_1	155,520	514,878	3.3107
11 Jul 2014 17:06:42	1318247	16650009	hadcm3n_86ge_1980_40_008514869_1	129,600	421,369	3.2513
08 Jul 2014 18:44:59	1318247	16650009	hadcm3n_86ge_1980_40_008514869_1	103,680	338,911	3.2688
24 Jun 2014 20:19:22	1318247	16650009	hadcm3n_86ge_1980_40_008514869_1	77,760	229,195	2.9475
16 Jun 2014 11:13:36	1318247	16650009	hadcm3n_86ge_1980_40_008514869_1	51,840	153,489	2.9608
30 May 2014 06:31:28	1318247	16650009	hadcm3n_86ge_1980_40_008514869_1	25,920	66,292	2.5576