Task 15689033

Name	hadcm3n_4ihu_1940_40_008309769_2
Workunit	8460904
Created	28 Mar 2013, 15:29:49 UTC
Sent	28 Mar 2013, 15:29:55 UTC
Report deadline	27 Jun 2013, 22:57:06 UTC
Received	12 Jun 2013, 11:14:55 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1118216
Run time	22 days 22 hours 20 min 4 sec
CPU time	21 days 18 hours 5 min 14 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	2.45 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7380, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6484, iMonCtr=1 Model crash detected, will try to restart... 07:51:20 (3048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:53:11 (4864): No heartbeat from core client for 30 sec - exiting 07:53:12 (4864): No heartbeat from core client for 30 sec - exiting 07:53:13 (4864): No heartbeat from core client for 30 sec - exiting 07:53:14 (4864): No heartbeat from core client for 30 sec - exiting 07:53:15 (4864): No heartbeat from core client for 30 sec - exiting 07:53:16 (4864): No heartbeat from core client for 30 sec - exiting 07:53:17 (4864): No heartbeat from core client for 30 sec - exiting 07:53:18 (4864): No heartbeat from core client for 30 sec - exiting 07:53:19 (4864): No heartbeat from core client for 30 sec - exiting 07:53:20 (4864): No heartbeat from core client for 30 sec - exiting 07:53:22 (4864): No heartbeat from core client for 30 sec - exiting 07:53:23 (4864): No heartbeat from core client for 30 sec - exiting 07:53:24 (4864): No heartbeat from core client for 30 sec - exiting 07:53:25 (4864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:33:10 (2488): No heartbeat from core client for 30 sec - exiting 07:33:11 (2488): No heartbeat from core client for 30 sec - exiting 07:33:12 (2488): No heartbeat from core client for 30 sec - exiting 07:33:13 (2488): No heartbeat from core client for 30 sec - exiting 07:33:14 (2488): No heartbeat from core client for 30 sec - exiting 07:33:15 (2488): No heartbeat from core client for 30 sec - exiting 07:33:16 (2488): No heartbeat from core client for 30 sec - exiting 07:33:17 (2488): No heartbeat from core client for 30 sec - exiting 07:33:18 (2488): No heartbeat from core client for 30 sec - exiting 07:33:19 (2488): No heartbeat from core client for 30 sec - exiting 07:33:20 (2488): No heartbeat from core client for 30 sec - exiting 07:33:21 (2488): No heartbeat from core client for 30 sec - exiting 07:33:22 (2488): No heartbeat from core client for 30 sec - exiting 07:33:23 (2488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:29:58 (3556): No heartbeat from core client for 30 sec - exiting 07:29:59 (3556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:24:52 (4164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4004, iMonCtr=1 Model crash detected, will try to restart... 12:49:03 (3884): No heartbeat from core client for 30 sec - exiting 12:49:04 (3884): No heartbeat from core client for 30 sec - exiting 12:49:05 (3884): No heartbeat from core client for 30 sec - exiting 12:49:06 (3884): No heartbeat from core client for 30 sec - exiting 12:49:07 (3884): No heartbeat from core client for 30 sec - exiting 12:49:08 (3884): No heartbeat from core client for 30 sec - exiting 12:49:09 (3884): No heartbeat from core client for 30 sec - exiting 12:49:10 (3884): No heartbeat from core client for 30 sec - exiting 12:49:11 (3884): No heartbeat from core client for 30 sec - exiting 12:49:12 (3884): No heartbeat from core client for 30 sec - exiting 12:49:13 (3884): No heartbeat from core client for 30 sec - exiting 12:49:14 (3884): No heartbeat from core client for 30 sec - exiting 12:49:15 (3884): No heartbeat from core client for 30 sec - exiting 12:49:16 (3884): No heartbeat from core client for 30 sec - exiting 12:49:17 (3884): No heartbeat from core client for 30 sec - exiting 12:49:18 (3884): No heartbeat from core client for 30 sec - exiting 12:49:19 (3884): No heartbeat from core client for 30 sec - exiting 12:49:20 (3884): No heartbeat from core client for 30 sec - exiting 12:49:21 (3884): No heartbeat from core client for 30 sec - exiting 12:49:22 (3884): No heartbeat from core client for 30 sec - exiting 12:49:23 (3884): No heartbeat from core client for 30 sec - exiting 12:49:24 (3884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6136, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5392, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5392, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5016, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2820, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2936, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6416, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:25:26 (1844): No heartbeat from core client for 30 sec - exiting 06:25:27 (1844): No heartbeat from core client for 30 sec - exiting 06:25:29 (1844): No heartbeat from core client for 30 sec - exiting 06:25:30 (1844): No heartbeat from core client for 30 sec - exiting 06:25:31 (1844): No heartbeat from core client for 30 sec - exiting 06:25:32 (1844): No heartbeat from core client for 30 sec - exiting 06:25:33 (1844): No heartbeat from core client for 30 sec - exiting 06:25:34 (1844): No heartbeat from core client for 30 sec - exiting 06:25:35 (1844): No heartbeat from core client for 30 sec - exiting 06:25:36 (1844): No heartbeat from core client for 30 sec - exiting 06:25:37 (1844): No heartbeat from core client for 30 sec - exiting 06:25:38 (1844): No heartbeat from core client for 30 sec - exiting 06:25:39 (1844): No heartbeat from core client for 30 sec - exiting 06:25:41 (1844): No heartbeat from core client for 30 sec - exiting 06:25:42 (1844): No heartbeat from core client for 30 sec - exiting 06:25:43 (1844): No heartbeat from core client for 30 sec - exiting 06:25:44 (1844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:35:19 (7076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4016, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6328, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
12 Jun 2013 10:13:00	1118216	15689033	hadcm3n_4ihu_1940_40_008309769_2	1,036,800	1,878,767	1.8121
11 Jun 2013 08:43:11	1118216	15689033	hadcm3n_4ihu_1940_40_008309769_2	1,010,880	1,830,722	1.8110
10 Jun 2013 10:48:39	1118216	15689033	hadcm3n_4ihu_1940_40_008309769_2	984,960	1,782,160	1.8094
08 Jun 2013 20:38:54	1118216	15689033	hadcm3n_4ihu_1940_40_008309769_2	959,040	1,732,262	1.8062
07 Jun 2013 21:47:45	1118216	15689033	hadcm3n_4ihu_1940_40_008309769_2	933,120	1,683,241	1.8039
05 Jun 2013 20:29:05	1118216	15689033	hadcm3n_4ihu_1940_40_008309769_2	907,200	1,634,407	1.8016
04 Jun 2013 18:51:13	1118216	15689033	hadcm3n_4ihu_1940_40_008309769_2	881,280	1,585,153	1.7987
03 Jun 2013 12:16:23	1118216	15689033	hadcm3n_4ihu_1940_40_008309769_2	855,360	1,536,883	1.7968
02 Jun 2013 11:04:33	1118216	15689033	hadcm3n_4ihu_1940_40_008309769_2	829,440	1,487,727	1.7937
01 Jun 2013 10:50:03	1118216	15689033	hadcm3n_4ihu_1940_40_008309769_2	803,520	1,439,314	1.7913
30 May 2013 10:14:41	1118216	15689033	hadcm3n_4ihu_1940_40_008309769_2	777,600	1,390,728	1.7885
28 May 2013 20:01:22	1118216	15689033	hadcm3n_4ihu_1940_40_008309769_2	751,680	1,345,422	1.7899
27 May 2013 23:09:55	1118216	15689033	hadcm3n_4ihu_1940_40_008309769_2	725,760	1,300,349	1.7917
27 May 2013 08:28:48	1118216	15689033	hadcm3n_4ihu_1940_40_008309769_2	699,840	1,255,156	1.7935
26 May 2013 07:49:47	1118216	15689033	hadcm3n_4ihu_1940_40_008309769_2	673,920	1,210,227	1.7958
25 May 2013 08:52:09	1118216	15689033	hadcm3n_4ihu_1940_40_008309769_2	648,000	1,165,075	1.7980
15 May 2013 12:11:45	1118216	15689033	hadcm3n_4ihu_1940_40_008309769_2	622,080	1,118,965	1.7987
12 May 2013 18:40:08	1118216	15689033	hadcm3n_4ihu_1940_40_008309769_2	596,160	1,073,714	1.8011
11 May 2013 17:36:51	1118216	15689033	hadcm3n_4ihu_1940_40_008309769_2	570,240	1,026,042	1.7993
10 May 2013 15:15:38	1118216	15689033	hadcm3n_4ihu_1940_40_008309769_2	544,320	979,568	1.7996