Task 16067160

Name	hadcm3n_ocjl_1900_40_008471380_2
Workunit	8622219
Created	13 Oct 2013, 19:49:31 UTC
Sent	13 Oct 2013, 19:50:08 UTC
Report deadline	13 Jan 2014, 3:17:19 UTC
Received	11 Feb 2014, 2:44:02 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1122348
Run time	24 days 0 hours 13 min 4 sec
CPU time	23 days 21 hours 53 min 57 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	2.29 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5904, iMonCtr=1 Model crash detected, will try to restart... 03:38:43 (7124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:48:42 (6332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6076, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5704, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=224, iMonCtr=1 Model crash detected, will try to restart... 09:04:53 (5536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:32:36 (7968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:37:40 (2300): No heartbeat from core client for 30 sec - exiting 00:37:41 (2300): No heartbeat from core client for 30 sec - exiting 00:37:42 (2300): No heartbeat from core client for 30 sec - exiting 00:37:43 (2300): No heartbeat from core client for 30 sec - exiting 00:37:44 (2300): No heartbeat from core client for 30 sec - exiting 00:37:45 (2300): No heartbeat from core client for 30 sec - exiting 00:37:46 (2300): No heartbeat from core client for 30 sec - exiting 00:37:47 (2300): No heartbeat from core client for 30 sec - exiting 00:37:48 (2300): No heartbeat from core client for 30 sec - exiting 00:37:49 (2300): No heartbeat from core client for 30 sec - exiting 00:37:50 (2300): No heartbeat from core client for 30 sec - exiting 00:37:51 (2300): No heartbeat from core client for 30 sec - exiting 00:37:52 (2300): No heartbeat from core client for 30 sec - exiting 00:37:53 (2300): No heartbeat from core client for 30 sec - exiting 00:37:54 (2300): No heartbeat from core client for 30 sec - exiting 00:37:55 (2300): No heartbeat from core client for 30 sec - exiting 00:37:56 (2300): No heartbeat from core client for 30 sec - exiting 00:37:57 (2300): No heartbeat from core client for 30 sec - exiting 00:37:58 (2300): No heartbeat from core client for 30 sec - exiting 00:37:59 (2300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5968, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6416, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:02:09 (8284): No heartbeat from core client for 30 sec - exiting 04:02:10 (8284): No heartbeat from core client for 30 sec - exiting 04:02:11 (8284): No heartbeat from core client for 30 sec - exiting 04:02:12 (8284): No heartbeat from core client for 30 sec - exiting 04:02:13 (8284): No heartbeat from core client for 30 sec - exiting 04:02:14 (8284): No heartbeat from core client for 30 sec - exiting 04:02:15 (8284): No heartbeat from core client for 30 sec - exiting 04:02:16 (8284): No heartbeat from core client for 30 sec - exiting 04:02:17 (8284): No heartbeat from core client for 30 sec - exiting 04:02:18 (8284): No heartbeat from core client for 30 sec - exiting 04:02:19 (8284): No heartbeat from core client for 30 sec - exiting 04:02:20 (8284): No heartbeat from core client for 30 sec - exiting 04:02:21 (8284): No heartbeat from core client for 30 sec - exiting 04:02:22 (8284): No heartbeat from core client for 30 sec - exiting 04:02:23 (8284): No heartbeat from core client for 30 sec - exiting 04:02:24 (8284): No heartbeat from core client for 30 sec - exiting 04:02:25 (8284): No heartbeat from core client for 30 sec - exiting 04:02:26 (8284): No heartbeat from core client for 30 sec - exiting 04:02:27 (8284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6452, iMonCtr=1 Model crash detected, will try to restart... 01:10:32 (5680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:12:24 (7548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:14:17 (7232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:35:26 (6828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:37:14 (6764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:38:57 (4872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:40:37 (2852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:42:18 (2804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7732, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6512, iMonCtr=1 Model crash detected, will try to restart... 21:33:47 (5668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6536, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6072, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6008, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5812, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5812, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5812, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6024, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6368, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5828, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5828, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3512, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5488, iMonCtr=1 Model crash detected, will try to restart... 10:54:44 (5680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:57:05 (7812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6444, iMonCtr=1 Model crash detected, will try to restart... 01:32:31 (5556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:08:02 (4640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:42:47 (6956): No heartbeat from core client for 30 sec - exiting 19:42:49 (6956): No heartbeat from core client for 30 sec - exiting 19:42:50 (6956): No heartbeat from core client for 30 sec - exiting 19:42:51 (6956): No heartbeat from core client for 30 sec - exiting 19:42:52 (6956): No heartbeat from core client for 30 sec - exiting 19:42:53 (6956): No heartbeat from core client for 30 sec - exiting 19:42:54 (6956): No heartbeat from core client for 30 sec - exiting 19:42:55 (6956): No heartbeat from core client for 30 sec - exiting 19:42:56 (6956): No heartbeat from core client for 30 sec - exiting 19:42:57 (6956): No heartbeat from core client for 30 sec - exiting 19:42:58 (6956): No heartbeat from core client for 30 sec - exiting 19:42:59 (6956): No heartbeat from core client for 30 sec - exiting 19:43:00 (6956): No heartbeat from core client for 30 sec - exiting 19:43:01 (6956): No heartbeat from core client for 30 sec - exiting 19:43:02 (6956): No heartbeat from core client for 30 sec - exiting 19:43:03 (6956): No heartbeat from core client for 30 sec - exiting 19:43:04 (6956): No heartbeat from core client for 30 sec - exiting 19:43:05 (6956): No heartbeat from core client for 30 sec - exiting 19:43:06 (6956): No heartbeat from core client for 30 sec - exiting 19:43:07 (6956): No heartbeat from core client for 30 sec - exiting 19:43:08 (6956): No heartbeat from core client for 30 sec - exiting 19:43:09 (6956): No heartbeat from core client for 30 sec - exiting 19:43:10 (6956): No heartbeat from core client for 30 sec - exiting 19:43:11 (6956): No heartbeat from core client for 30 sec - exiting 19:43:12 (6956): No heartbeat from core client for 30 sec - exiting 19:43:13 (6956): No heartbeat from core client for 30 sec - exiting 19:43:14 (6956): No heartbeat from core client for 30 sec - exiting 19:43:15 (6956): No heartbeat from core client for 30 sec - exiting 19:43:16 (6956): No heartbeat from core client for 30 sec - exiting 19:43:17 (6956): No heartbeat from core client for 30 sec - exiting 19:43:18 (6956): No heartbeat from core client for 30 sec - exiting 19:43:19 (6956): No heartbeat from core client for 30 sec - exiting 19:43:20 (6956): No heartbeat from core client for 30 sec - exiting 19:43:21 (6956): No heartbeat from core client for 30 sec - exiting 19:43:22 (6956): No heartbeat from core client for 30 sec - exiting 19:43:23 (6956): No heartbeat from core client for 30 sec - exiting 19:43:24 (6956): No heartbeat from core client for 30 sec - exiting 19:43:25 (6956): No heartbeat from core client for 30 sec - exiting 19:43:26 (6956): No heartbeat from core client for 30 sec - exiting 19:43:27 (6956): No heartbeat from core client for 30 sec - exiting 19:43:28 (6956): No heartbeat from core client for 30 sec - exiting 19:43:29 (6956): No heartbeat from core client for 30 sec - exiting 19:43:30 (6956): No heartbeat from core client for 30 sec - exiting 19:43:31 (6956): No heartbeat from core client for 30 sec - exiting 19:43:32 (6956): No heartbeat from core client for 30 sec - exiting 19:43:33 (6956): No heartbeat from core client for 30 sec - exiting 19:43:34 (6956): No heartbeat from core client for 30 sec - exiting 19:43:35 (6956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/ocjlko.pjd1c10 Error converting file to netcdf: dataout/ocjlko.pid1c10 Error converting file to netcdf: dataout/ocjlko.pfd1c10 Error converting file to netcdf: dataout/ocjlka.phd1c10 Error converting file to netcdf: dataout/ocjlka.pgd1c10 Error converting file to netcdf: dataout/ocjlka.ped1c10 Error converting file to netcdf: dataout/ocjlka.pdd1c10 19:49:13 (7576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:54:03 (8004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:57:16 (5584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:09:11 (2324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:17:41 (7112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6680, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5780, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5780, iMonCtr=1 Model crash detected, will try to restart... 03:33:03 (6920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5532, iMonCtr=1 Model crash detected, will try to restart... 17:41:53 (1828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
11 Feb 2014 01:44:40	1122348	16067160	hadcm3n_ocjl_1900_40_008471380_2	1,036,800	2,065,236	1.9919
07 Feb 2014 01:24:01	1122348	16067160	hadcm3n_ocjl_1900_40_008471380_2	1,010,880	2,015,051	1.9934
05 Feb 2014 09:31:04	1122348	16067160	hadcm3n_ocjl_1900_40_008471380_2	984,960	1,961,969	1.9919
04 Feb 2014 09:09:08	1122348	16067160	hadcm3n_ocjl_1900_40_008471380_2	959,040	1,911,696	1.9933
31 Jan 2014 08:28:47	1122348	16067160	hadcm3n_ocjl_1900_40_008471380_2	933,120	1,859,106	1.9924
31 Jan 2014 07:28:28	1122348	16067160	hadcm3n_ocjl_1900_40_008471380_2	907,200	1,805,284	1.9900
28 Jan 2014 06:10:46	1122348	16067160	hadcm3n_ocjl_1900_40_008471380_2	881,280	1,749,718	1.9854
24 Jan 2014 11:26:33	1122348	16067160	hadcm3n_ocjl_1900_40_008471380_2	855,360	1,693,329	1.9797
23 Jan 2014 09:25:25	1122348	16067160	hadcm3n_ocjl_1900_40_008471380_2	829,440	1,637,826	1.9746
17 Jan 2014 01:45:27	1122348	16067160	hadcm3n_ocjl_1900_40_008471380_2	803,520	1,582,113	1.9690
15 Jan 2014 04:22:49	1122348	16067160	hadcm3n_ocjl_1900_40_008471380_2	777,600	1,525,610	1.9619
10 Jan 2014 10:32:54	1122348	16067160	hadcm3n_ocjl_1900_40_008471380_2	751,680	1,476,947	1.9649
08 Jan 2014 22:29:11	1122348	16067160	hadcm3n_ocjl_1900_40_008471380_2	725,760	1,436,414	1.9792
08 Jan 2014 10:41:21	1122348	16067160	hadcm3n_ocjl_1900_40_008471380_2	699,840	1,391,767	1.9887
07 Jan 2014 21:22:19	1122348	16067160	hadcm3n_ocjl_1900_40_008471380_2	673,920	1,343,096	1.9930
07 Jan 2014 07:47:43	1122348	16067160	hadcm3n_ocjl_1900_40_008471380_2	648,000	1,297,548	2.0024
06 Jan 2014 18:28:31	1122348	16067160	hadcm3n_ocjl_1900_40_008471380_2	622,080	1,249,636	2.0088
24 Dec 2013 13:54:55	1122348	16067160	hadcm3n_ocjl_1900_40_008471380_2	596,160	1,204,264	2.0200
20 Dec 2013 11:11:31	1122348	16067160	hadcm3n_ocjl_1900_40_008471380_2	570,240	1,156,090	2.0274
18 Dec 2013 02:25:01	1122348	16067160	hadcm3n_ocjl_1900_40_008471380_2	544,320	1,099,985	2.0208