Task 12830413

Name	hadcm3n_p5wr_1900_40_007225243_0
Workunit	7423483
Created	26 Apr 2011, 15:34:18 UTC
Sent	27 Apr 2011, 22:08:14 UTC
Report deadline	28 Jul 2011, 5:35:25 UTC
Received	8 Jun 2011, 8:58:43 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
Computer ID	1146283
Run time	11 days 3 hours 26 min 27 sec
CPU time	10 days 19 hours 14 min 55 sec
Validate state	Invalid
Credit	6,531.84
Device peak FLOPS	2.27 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.60</core_client_version> <![CDATA[ <message> too many exit(0)s </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4856, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4928, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:18:24 (908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:18:26 (908): No heartbeat from core client for 30 sec - exiting 15:18:27 (908): No heartbeat from core client for 30 sec - exiting 15:18:28 (908): No heartbeat from core client for 30 sec - exiting 15:18:29 (908): No heartbeat from core client for 30 sec - exiting 15:18:30 (908): No heartbeat from core client for 30 sec - exiting 15:18:31 (908): No heartbeat from core client for 30 sec - exiting 15:18:32 (908): No heartbeat from core client for 30 sec - exiting 15:18:33 (908): No heartbeat from core client for 30 sec - exiting 15:18:34 (908): No heartbeat from core client for 30 sec - exiting 15:18:35 (908): No heartbeat from core client for 30 sec - exiting 15:18:36 (908): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:27:30 (5560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:27:31 (5560): No heartbeat from core client for 30 sec - exiting 13:27:32 (5560): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:06:27 (6484): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 17:06:35 (6484): No heartbeat from core client for 30 sec - exiting 17:06:38 (6484): No heartbeat from core client for 30 sec - exiting 17:06:39 (6484): No heartbeat from core client for 30 sec - exiting 17:06:40 (6484): No heartbeat from core client for 30 sec - exiting 17:06:41 (6484): No heartbeat from core client for 30 sec - exiting 17:06:42 (6484): No heartbeat from core client for 30 sec - exiting 17:06:43 (6484): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:52:11 (1964): No heartbeat from core client for 30 sec - exiting 04:52:13 (1964): No heartbeat from core client for 30 sec - exiting 04:52:14 (1964): No heartbeat from core client for 30 sec - exiting 04:52:15 (1964): No heartbeat from core client for 30 sec - exiting 04:52:16 (1964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:52:17 (1964): No heartbeat from core client for 30 sec - exiting 04:52:18 (1964): No heartbeat from core client for 30 sec - exiting 04:52:19 (1964): No heartbeat from core client for 30 sec - exiting 04:52:20 (1964): No heartbeat from core client for 30 sec - exiting 04:52:21 (1964): No heartbeat from core client for 30 sec - exiting 04:52:22 (1964): No heartbeat from core client for 30 sec - exiting 04:52:23 (1964): No heartbeat from core client for 30 sec - exiting </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
05 Jun 2011 03:29:23	1146283	12830413	hadcm3n_p5wr_1900_40_007225243_0	544,320	895,429	1.6450
03 Jun 2011 02:06:13	1146283	12830413	hadcm3n_p5wr_1900_40_007225243_0	518,400	851,612	1.6428
19 May 2011 15:18:55	1146283	12830413	hadcm3n_p5wr_1900_40_007225243_0	492,480	795,980	1.6163
16 May 2011 22:09:36	1146283	12830413	hadcm3n_p5wr_1900_40_007225243_0	466,560	742,151	1.5907
15 May 2011 11:54:12	1146283	12830413	hadcm3n_p5wr_1900_40_007225243_0	440,640	697,863	1.5837
12 May 2011 22:20:00	1146283	12830413	hadcm3n_p5wr_1900_40_007225243_0	414,720	653,013	1.5746
11 May 2011 00:13:13	1146283	12830413	hadcm3n_p5wr_1900_40_007225243_0	388,800	606,038	1.5587
06 May 2011 05:05:13	1146283	12830413	hadcm3n_p5wr_1900_40_007225243_0	362,880	548,833	1.5124
04 May 2011 23:15:13	1146283	12830413	hadcm3n_p5wr_1900_40_007225243_0	336,960	504,247	1.4965
04 May 2011 12:15:09	1146283	12830413	hadcm3n_p5wr_1900_40_007225243_0	311,040	465,043	1.4951
04 May 2011 01:53:48	1146283	12830413	hadcm3n_p5wr_1900_40_007225243_0	285,120	428,600	1.5032
03 May 2011 14:03:05	1146283	12830413	hadcm3n_p5wr_1900_40_007225243_0	259,200	388,286	1.4980
03 May 2011 02:49:27	1146283	12830413	hadcm3n_p5wr_1900_40_007225243_0	233,280	349,220	1.4970
02 May 2011 07:03:19	1146283	12830413	hadcm3n_p5wr_1900_40_007225243_0	207,360	308,602	1.4882
01 May 2011 06:32:46	1146283	12830413	hadcm3n_p5wr_1900_40_007225243_0	181,440	270,147	1.4889
30 Apr 2011 20:01:33	1146283	12830413	hadcm3n_p5wr_1900_40_007225243_0	155,520	233,176	1.4993
30 Apr 2011 09:29:59	1146283	12830413	hadcm3n_p5wr_1900_40_007225243_0	129,600	195,420	1.5079
29 Apr 2011 22:39:27	1146283	12830413	hadcm3n_p5wr_1900_40_007225243_0	103,680	158,276	1.5266
29 Apr 2011 12:25:28	1146283	12830413	hadcm3n_p5wr_1900_40_007225243_0	77,760	121,839	1.5669
29 Apr 2011 01:49:26	1146283	12830413	hadcm3n_p5wr_1900_40_007225243_0	51,840	84,761	1.6351