Task 12824628

Name	hadcm3n_p3og_1900_40_007222352_1
Workunit	7420592
Created	26 Apr 2011, 15:25:39 UTC
Sent	30 Apr 2011, 19:14:55 UTC
Report deadline	31 Jul 2011, 2:42:06 UTC
Received	9 May 2011, 6:50:36 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
Computer ID	1187962
Run time	4 days 4 hours 35 min 42 sec
CPU time	3 days 1 hours 40 min 2 sec
Validate state	Invalid
Credit	1,555.20
Device peak FLOPS	2.23 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> too many exit(0)s </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4728, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:09:53 (7148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:09:54 (7148): No heartbeat from core client for 30 sec - exiting 03:09:55 (7148): No heartbeat from core client for 30 sec - exiting 03:09:56 (7148): No heartbeat from core client for 30 sec - exiting 03:09:57 (7148): No heartbeat from core client for 30 sec - exiting 03:09:58 (7148): No heartbeat from core client for 30 sec - exiting 03:09:59 (7148): No heartbeat from core client for 30 sec - exiting 03:10:00 (7148): No heartbeat from core client for 30 sec - exiting 03:10:01 (7148): No heartbeat from core client for 30 sec - exiting 03:10:02 (7148): No heartbeat from core client for 30 sec - exiting 03:10:03 (7148): No heartbeat from core client for 30 sec - exiting 03:13:23 (7244): No heartbeat from core client for 30 sec - exiting 03:13:24 (7244): No heartbeat from core client for 30 sec - exiting 03:13:25 (7244): No heartbeat from core client for 30 sec - exiting 03:13:26 (7244): No heartbeat from core client for 30 sec - exiting 03:13:27 (7244): No heartbeat from core client for 30 sec - exiting 03:13:28 (7244): No heartbeat from core client for 30 sec - exiting 03:13:29 (7244): No heartbeat from core client for 30 sec - exiting 03:13:30 (7244): No heartbeat from core client for 30 sec - exiting 03:13:31 (7244): No heartbeat from core client for 30 sec - exiting 03:13:32 (7244): No heartbeat from core client for 30 sec - exiting 03:13:33 (7244): No heartbeat from core client for 30 sec - exiting 03:13:34 (7244): No heartbeat from core client for 30 sec - exiting 03:13:35 (7244): No heartbeat from core client for 30 sec - exiting 03:13:36 (7244): No heartbeat from core client for 30 sec - exiting 03:13:37 (7244): No heartbeat from core client for 30 sec - exiting 03:13:38 (7244): No heartbeat from core client for 30 sec - exiting 03:13:39 (7244): No heartbeat from core client for 30 sec - exiting 03:13:40 (7244): No heartbeat from core client for 30 sec - exiting 03:13:41 (7244): No heartbeat from core client for 30 sec - exiting 03:13:42 (7244): No heartbeat from core client for 30 sec - exiting 03:13:43 (7244): No heartbeat from core client for 30 sec - exiting 03:13:44 (7244): No heartbeat from core client for 30 sec - exiting 03:13:45 (7244): No heartbeat from core client for 30 sec - exiting 03:13:46 (7244): No heartbeat from core client for 30 sec - exiting 03:13:47 (7244): No heartbeat from core client for 30 sec - exiting 03:13:48 (7244): No heartbeat from core client for 30 sec - exiting 03:13:49 (7244): No heartbeat from core client for 30 sec - exiting 03:13:50 (7244): No heartbeat from core client for 30 sec - exiting 03:13:51 (7244): No heartbeat from core client for 30 sec - exiting 03:13:52 (7244): No heartbeat from core client for 30 sec - exiting 03:13:53 (7244): No heartbeat from core client for 30 sec - exiting 03:13:54 (7244): No heartbeat from core client for 30 sec - exiting 03:13:55 (7244): No heartbeat from core client for 30 sec - exiting 03:13:56 (7244): No heartbeat from core client for 30 sec - exiting 03:13:57 (7244): No heartbeat from core client for 30 sec - exiting 03:13:58 (7244): No heartbeat from core client for 30 sec - exiting 03:13:59 (7244): No heartbeat from core client for 30 sec - exiting 03:14:00 (7244): No heartbeat from core client for 30 sec - exiting 03:14:01 (7244): No heartbeat from core client for 30 sec - exiting 03:14:02 (7244): No heartbeat from core client for 30 sec - exiting 03:14:03 (7244): No heartbeat from core client for 30 sec - exiting 03:14:04 (7244): No heartbeat from core client for 30 sec - exiting 03:14:05 (7244): No heartbeat from core client for 30 sec - exiting 03:14:06 (7244): No heartbeat from core client for 30 sec - exiting 03:14:07 (7244): No heartbeat from core client for 30 sec - exiting 03:14:08 (7244): No heartbeat from core client for 30 sec - exiting 03:14:09 (7244): No heartbeat from core client for 30 sec - exiting 03:14:10 (7244): No heartbeat from core client for 30 sec - exiting 03:14:11 (7244): No heartbeat from core client for 30 sec - exiting 03:14:12 (7244): No heartbeat from core client for 30 sec - exiting 03:14:13 (7244): No heartbeat from core client for 30 sec - exiting 03:14:14 (7244): No heartbeat from core client for 30 sec - exiting 03:14:15 (7244): No heartbeat from core client for 30 sec - exiting 03:14:16 (7244): No heartbeat from core client for 30 sec - exiting 03:14:17 (7244): No heartbeat from core client for 30 sec - exiting 03:14:18 (7244): No heartbeat from core client for 30 sec - exiting 03:14:19 (7244): No heartbeat from core client for 30 sec - exiting 03:14:20 (7244): No heartbeat from core client for 30 sec - exiting 03:14:21 (7244): No heartbeat from core client for 30 sec - exiting 03:14:22 (7244): No heartbeat from core client for 30 sec - exiting 03:14:23 (7244): No heartbeat from core client for 30 sec - exiting 03:14:24 (7244): No heartbeat from core client for 30 sec - exiting 03:14:25 (7244): No heartbeat from core client for 30 sec - exiting 03:14:26 (7244): No heartbeat from core client for 30 sec - exiting 03:14:27 (7244): No heartbeat from core client for 30 sec - exiting 03:14:28 (7244): No heartbeat from core client for 30 sec - exiting 03:14:29 (7244): No heartbeat from core client for 30 sec - exiting 03:14:30 (7244): No heartbeat from core client for 30 sec - exiting 03:14:31 (7244): No heartbeat from core client for 30 sec - exiting 03:14:32 (7244): No heartbeat from core client for 30 sec - exiting 03:14:33 (7244): No heartbeat from core client for 30 sec - exiting 03:14:34 (7244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:17:50 (3028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:19:50 (7576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:21:51 (7832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:23:27 (6392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:25:27 (7388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:27:03 (4876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:29:03 (7524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:30:39 (3052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:32:39 (7484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:34:15 (7040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:36:15 (6984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:38:15 (5784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:39:51 (6240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:41:51 (7900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:43:27 (2032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:45:27 (6708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:47:03 (5312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:49:03 (7512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:50:39 (6308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:52:39 (5932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:54:15 (7740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:56:15 (8140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:57:51 (5400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:59:51 (7052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:01:27 (5784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:03:27 (7404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:05:03 (4876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:07:03 (468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:09:04 (8024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:10:40 (8080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:12:40 (6648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:14:16 (7780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:16:16 (3028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:17:52 (5268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:19:52 (7576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:21:28 (5364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:23:28 (6696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:25:04 (7652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:27:04 (1280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:28:40 (6764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:30:40 (5496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:32:16 (7244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:34:16 (7156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:35:52 (5684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:37:52 (7980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:39:28 (2564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:41:28 (7820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:43:04 (8164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:45:04 (7852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:47:04 (8076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:49:04 (7836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:50:40 (7364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:52:40 (3112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:54:16 (3484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:56:16 (2608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:57:53 (6596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:59:53 (2996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:01:29 (6208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:03:29 (8044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:05:05 (6540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:07:05 (4964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:08:41 (4840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:10:41 (6196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:12:17 (7276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:14:17 (7628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:15:53 (7016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:17:53 (7604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:19:29 (6220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:21:29 (1264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:23:29 (8092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:25:05 (7636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:27:05 (7720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:28:41 (4308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:30:41 (8088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:32:17 (3196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:34:17 (6836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:35:53 (3068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:37:53 (5932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:39:29 (6228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:41:29 (5052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:43:05 (2384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:45:05 (7652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:46:42 (7576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:48:42 (6652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:51:30 (4980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:53:30 (2988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:55:06 (8080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:57:06 (5756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:58:42 (5784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:00:42 (7708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:02:18 (8016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:04:18 (4868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:05:54 (5312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:07:54 (4072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:09:30 (7560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:11:30 (7456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:13:06 (6268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:15:06 (7136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:16:42 (7328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 May 2011 07:53:47	989679	12824628	hadcm3n_p3og_1900_40_007222352_1	129,600	229,460	1.7705
05 May 2011 04:27:38	989679	12824628	hadcm3n_p3og_1900_40_007222352_1	103,680	182,170	1.7570
04 May 2011 02:34:28	989679	12824628	hadcm3n_p3og_1900_40_007222352_1	77,760	136,911	1.7607
02 May 2011 21:12:32	989679	12824628	hadcm3n_p3og_1900_40_007222352_1	51,840	92,482	1.7840
01 May 2011 15:55:14	989679	12824628	hadcm3n_p3og_1900_40_007222352_1	25,920	46,088	1.7781