Task 13879860

Name	hadam3p_eu_xoma_1993_1_006993914_1
Workunit	7197230
Created	5 Jan 2012, 16:40:43 UTC
Sent	5 Jan 2012, 16:41:37 UTC
Report deadline	17 Dec 2012, 22:01:37 UTC
Received	20 Jan 2012, 7:24:52 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1020546
Run time	4 days 15 hours 40 min 28 sec
CPU time	4 days 10 hours 15 min 2 sec
Validate state	Workunit error - check skipped
Credit	2,386.39
Device peak FLOPS	2.54 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:30:55 (3968): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 09:33:00 (3968): No heartbeat from core client for 30 sec - exiting 09:33:01 (3968): No heartbeat from core client for 30 sec - exiting 09:33:02 (3968): No heartbeat from core client for 30 sec - exiting 09:33:03 (3968): No heartbeat from core client for 30 sec - exiting 09:33:04 (3968): No heartbeat from core client for 30 sec - exiting 09:33:05 (3968): No heartbeat from core client for 30 sec - exiting 09:33:06 (3968): No heartbeat from core client for 30 sec - exiting 09:33:07 (3968): No heartbeat from core client for 30 sec - exiting 09:33:08 (3968): No heartbeat from core client for 30 sec - exiting 09:33:09 (3968): No heartbeat from core client for 30 sec - exiting 09:33:14 (3968): No heartbeat from core client for 30 sec - exiting 09:33:15 (3968): No heartbeat from core client for 30 sec - exiting 09:33:16 (3968): No heartbeat from core client for 30 sec - exiting 09:33:17 (3968): No heartbeat from core client for 30 sec - exiting 09:33:19 (3968): No heartbeat from core client for 30 sec - exiting 09:33:20 (3968): No heartbeat from core client for 30 sec - exiting 09:33:31 (3968): No heartbeat from core client for 30 sec - exiting 09:33:32 (3968): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 17:15:18 (16132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:15:38 (16132): No heartbeat from core client for 30 sec - exiting 17:15:41 (16132): No heartbeat from core client for 30 sec - exiting 17:15:42 (16132): No heartbeat from core client for 30 sec - exiting 17:21:30 (15852): No heartbeat from core client for 30 sec - exiting 17:21:31 (15852): No heartbeat from core client for 30 sec - exiting 17:21:32 (15852): No heartbeat from core client for 30 sec - exiting 17:21:33 (15852): No heartbeat from core client for 30 sec - exiting 17:21:34 (15852): No heartbeat from core client for 30 sec - exiting 17:21:35 (15852): No heartbeat from core client for 30 sec - exiting 17:21:36 (15852): No heartbeat from core client for 30 sec - exiting 17:21:37 (15852): No heartbeat from core client for 30 sec - exiting 17:21:38 (15852): No heartbeat from core client for 30 sec - exiting 17:21:39 (15852): No heartbeat from core client for 30 sec - exiting 17:21:40 (15852): No heartbeat from core client for 30 sec - exiting 17:21:41 (15852): No heartbeat from core client for 30 sec - exiting 17:21:42 (15852): No heartbeat from core client for 30 sec - exiting 17:21:43 (15852): No heartbeat from core client for 30 sec - exiting 17:21:44 (15852): No heartbeat from core client for 30 sec - exiting 17:21:45 (15852): No heartbeat from core client for 30 sec - exiting 17:21:46 (15852): No heartbeat from core client for 30 sec - exiting 17:21:47 (15852): No heartbeat from core client for 30 sec - exiting 17:21:48 (15852): No heartbeat from core client for 30 sec - exiting 17:21:49 (15852): No heartbeat from core client for 30 sec - exiting 17:21:50 (15852): No heartbeat from core client for 30 sec - exiting 17:21:51 (15852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:26:55 (14668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8116, selfPID=8116, iMonCtr=2 17:28:57 (18348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12424, selfPID=12424, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10704, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5144, selfPID=3440, iMonCtr=1 Model crash detected, will try to restart... 19:20:21 (4676): No heartbeat from core client for 30 sec - exiting 19:20:22 (4676): No heartbeat from core client for 30 sec - exiting 19:20:23 (4676): No heartbeat from core client for 30 sec - exiting 19:20:24 (4676): No heartbeat from core client for 30 sec - exiting 19:20:25 (4676): No heartbeat from core client for 30 sec - exiting 19:20:26 (4676): No heartbeat from core client for 30 sec - exiting 19:20:27 (4676): No heartbeat from core client for 30 sec - exiting 19:20:28 (4676): No heartbeat from core client for 30 sec - exiting 19:20:29 (4676): No heartbeat from core client for 30 sec - exiting 19:20:30 (4676): No heartbeat from core client for 30 sec - exiting 19:20:31 (4676): No heartbeat from core client for 30 sec - exiting 19:20:32 (4676): No heartbeat from core client for 30 sec - exiting 19:20:33 (4676): No heartbeat from core client for 30 sec - exiting 19:20:34 (4676): No heartbeat from core client for 30 sec - exiting 19:20:35 (4676): No heartbeat from core client for 30 sec - exiting 19:20:36 (4676): No heartbeat from core client for 30 sec - exiting 19:20:37 (4676): No heartbeat from core client for 30 sec - exiting 19:20:38 (4676): No heartbeat from core client for 30 sec - exiting 19:20:39 (4676): No heartbeat from core client for 30 sec - exiting 19:20:40 (4676): No heartbeat from core client for 30 sec - exiting 19:20:41 (4676): No heartbeat from core client for 30 sec - exiting 19:20:42 (4676): No heartbeat from core client for 30 sec - exiting 19:20:43 (4676): No heartbeat from core client for 30 sec - exiting 19:20:44 (4676): No heartbeat from core client for 30 sec - exiting 19:20:45 (4676): No heartbeat from core client for 30 sec - exiting 19:20:46 (4676): No heartbeat from core client for 30 sec - exiting 19:20:47 (4676): No heartbeat from core client for 30 sec - exiting 19:20:48 (4676): No heartbeat from core client for 30 sec - exiting 19:20:49 (4676): No heartbeat from core client for 30 sec - exiting 19:20:50 (4676): No heartbeat from core client for 30 sec - exiting 19:20:51 (4676): No heartbeat from core client for 30 sec - exiting 19:20:52 (4676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:45:33 (4416): No heartbeat from core client for 30 sec - exiting 05:45:34 (4416): No heartbeat from core client for 30 sec - exiting 05:45:35 (4416): No heartbeat from core client for 30 sec - exiting 05:45:36 (4416): No heartbeat from core client for 30 sec - exiting 05:45:37 (4416): No heartbeat from core client for 30 sec - exiting 05:45:38 (4416): No heartbeat from core client for 30 sec - exiting 05:45:39 (4416): No heartbeat from core client for 30 sec - exiting 05:45:40 (4416): No heartbeat from core client for 30 sec - exiting 05:45:41 (4416): No heartbeat from core client for 30 sec - exiting 05:45:42 (4416): No heartbeat from core client for 30 sec - exiting 05:45:43 (4416): No heartbeat from core client for 30 sec - exiting 05:45:44 (4416): No heartbeat from core client for 30 sec - exiting 05:45:45 (4416): No heartbeat from core client for 30 sec - exiting 05:45:46 (4416): No heartbeat from core client for 30 sec - exiting 05:45:47 (4416): No heartbeat from core client for 30 sec - exiting 05:45:48 (4416): No heartbeat from core client for 30 sec - exiting 05:45:49 (4416): No heartbeat from core client for 30 sec - exiting 05:45:50 (4416): No heartbeat from core client for 30 sec - exiting 05:45:51 (4416): No heartbeat from core client for 30 sec - exiting 05:45:52 (4416): No heartbeat from core client for 30 sec - exiting 05:45:53 (4416): No heartbeat from core client for 30 sec - exiting 05:45:54 (4416): No heartbeat from core client for 30 sec - exiting 05:45:55 (4416): No heartbeat from core client for 30 sec - exiting 05:45:56 (4416): No heartbeat from core client for 30 sec - exiting 05:45:57 (4416): No heartbeat from core client for 30 sec - exiting 05:45:58 (4416): No heartbeat from core client for 30 sec - exiting 05:45:59 (4416): No heartbeat from core client for 30 sec - exiting 05:46:00 (4416): No heartbeat from core client for 30 sec - exiting 05:46:01 (4416): No heartbeat from core client for 30 sec - exiting 05:46:02 (4416): No heartbeat from core client for 30 sec - exiting 05:46:03 (4416): No heartbeat from core client for 30 sec - exiting 05:46:04 (4416): No heartbeat from core client for 30 sec - exiting 05:46:05 (4416): No heartbeat from core client for 30 sec - exiting 05:46:06 (4416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:45:41 (3692): No heartbeat from core client for 30 sec - exiting 13:45:42 (3692): No heartbeat from core client for 30 sec - exiting 13:45:43 (3692): No heartbeat from core client for 30 sec - exiting 13:45:44 (3692): No heartbeat from core client for 30 sec - exiting 13:45:45 (3692): No heartbeat from core client for 30 sec - exiting 13:45:46 (3692): No heartbeat from core client for 30 sec - exiting 13:45:47 (3692): No heartbeat from core client for 30 sec - exiting 13:45:48 (3692): No heartbeat from core client for 30 sec - exiting 13:45:49 (3692): No heartbeat from core client for 30 sec - exiting 13:45:51 (3692): No heartbeat from core client for 30 sec - exiting 13:45:52 (3692): No heartbeat from core client for 30 sec - exiting 13:45:53 (3692): No heartbeat from core client for 30 sec - exiting 13:45:54 (3692): No heartbeat from core client for 30 sec - exiting 13:45:55 (3692): No heartbeat from core client for 30 sec - exiting 13:45:56 (3692): No heartbeat from core client for 30 sec - exiting 13:45:57 (3692): No heartbeat from core client for 30 sec - exiting 13:45:58 (3692): No heartbeat from core client for 30 sec - exiting 13:45:59 (3692): No heartbeat from core client for 30 sec - exiting 13:46:00 (3692): No heartbeat from core client for 30 sec - exiting 13:46:01 (3692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:19:08 (1400): No heartbeat from core client for 30 sec - exiting 15:19:09 (1400): No heartbeat from core client for 30 sec - exiting 15:19:10 (1400): No heartbeat from core client for 30 sec - exiting 15:19:11 (1400): No heartbeat from core client for 30 sec - exiting 15:19:12 (1400): No heartbeat from core client for 30 sec - exiting 15:19:13 (1400): No heartbeat from core client for 30 sec - exiting 15:19:14 (1400): No heartbeat from core client for 30 sec - exiting 15:19:15 (1400): No heartbeat from core client for 30 sec - exiting 15:19:16 (1400): No heartbeat from core client for 30 sec - exiting 15:19:17 (1400): No heartbeat from core client for 30 sec - exiting 15:19:18 (1400): No heartbeat from core client for 30 sec - exiting 15:19:19 (1400): No heartbeat from core client for 30 sec - exiting 15:19:20 (1400): No heartbeat from core client for 30 sec - exiting 15:19:21 (1400): No heartbeat from core client for 30 sec - exiting 15:19:22 (1400): No heartbeat from core client for 30 sec - exiting 15:19:23 (1400): No heartbeat from core client for 30 sec - exiting 15:19:24 (1400): No heartbeat from core client for 30 sec - exiting 15:19:25 (1400): No heartbeat from core client for 30 sec - exiting 15:19:26 (1400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:32:23 (4392): No heartbeat from core client for 30 sec - exiting 04:32:24 (4392): No heartbeat from core client for 30 sec - exiting 04:32:25 (4392): No heartbeat from core client for 30 sec - exiting 04:32:26 (4392): No heartbeat from core client for 30 sec - exiting 04:32:27 (4392): No heartbeat from core client for 30 sec - exiting 04:32:28 (4392): No heartbeat from core client for 30 sec - exiting 04:32:29 (4392): No heartbeat from core client for 30 sec - exiting 04:32:30 (4392): No heartbeat from core client for 30 sec - exiting 04:32:31 (4392): No heartbeat from core client for 30 sec - exiting 04:32:32 (4392): No heartbeat from core client for 30 sec - exiting 04:32:33 (4392): No heartbeat from core client for 30 sec - exiting 04:32:34 (4392): No heartbeat from core client for 30 sec - exiting 04:32:35 (4392): No heartbeat from core client for 30 sec - exiting 04:32:36 (4392): No heartbeat from core client for 30 sec - exiting 04:32:37 (4392): No heartbeat from core client for 30 sec - exiting 04:32:38 (4392): No heartbeat from core client for 30 sec - exiting 04:32:39 (4392): No heartbeat from core client for 30 sec - exiting 04:32:40 (4392): No heartbeat from core client for 30 sec - exiting 04:32:41 (4392): No heartbeat from core client for 30 sec - exiting 04:32:42 (4392): No heartbeat from core client for 30 sec - exiting 04:32:43 (4392): No heartbeat from core client for 30 sec - exiting 04:32:44 (4392): No heartbeat from core client for 30 sec - exiting 04:32:45 (4392): No heartbeat from core client for 30 sec - exiting 04:32:46 (4392): No heartbeat from core client for 30 sec - exiting 04:32:47 (4392): No heartbeat from core client for 30 sec - exiting 04:32:48 (4392): No heartbeat from core client for 30 sec - exiting 04:32:49 (4392): No heartbeat from core client for 30 sec - exiting 04:32:50 (4392): No heartbeat from core client for 30 sec - exiting 04:32:51 (4392): No heartbeat from core client for 30 sec - exiting 04:32:52 (4392): No heartbeat from core client for 30 sec - exiting 04:32:53 (4392): No heartbeat from core client for 30 sec - exiting 04:32:54 (4392): No heartbeat from core client for 30 sec - exiting 04:32:55 (4392): No heartbeat from core client for 30 sec - exiting 04:32:56 (4392): No heartbeat from core client for 30 sec - exiting 04:32:57 (4392): No heartbeat from core client for 30 sec - exiting 04:32:58 (4392): No heartbeat from core client for 30 sec - exiting 04:32:59 (4392): No heartbeat from core client for 30 sec - exiting 04:33:00 (4392): No heartbeat from core client for 30 sec - exiting 04:33:01 (4392): No heartbeat from core client for 30 sec - exiting 04:33:02 (4392): No heartbeat from core client for 30 sec - exiting 04:33:03 (4392): No heartbeat from core client for 30 sec - exiting 04:33:04 (4392): No heartbeat from core client for 30 sec - exiting 04:33:05 (4392): No heartbeat from core client for 30 sec - exiting 04:33:06 (4392): No heartbeat from core client for 30 sec - exiting 04:33:07 (4392): No heartbeat from core client for 30 sec - exiting 04:33:08 (4392): No heartbeat from core client for 30 sec - exiting 04:33:09 (4392): No heartbeat from core client for 30 sec - exiting 04:33:10 (4392): No heartbeat from core client for 30 sec - exiting 04:33:11 (4392): No heartbeat from core client for 30 sec - exiting 04:33:12 (4392): No heartbeat from core client for 30 sec - exiting 04:33:13 (4392): No heartbeat from core client for 30 sec - exiting 04:33:14 (4392): No heartbeat from core client for 30 sec - exiting 04:33:15 (4392): No heartbeat from core client for 30 sec - exiting 04:33:16 (4392): No heartbeat from core client for 30 sec - exiting 04:33:17 (4392): No heartbeat from core client for 30 sec - exiting 04:33:18 (4392): No heartbeat from core client for 30 sec - exiting 04:33:19 (4392): No heartbeat from core client for 30 sec - exiting 04:33:20 (4392): No heartbeat from core client for 30 sec - exiting 04:33:21 (4392): No heartbeat from core client for 30 sec - exiting 04:33:22 (4392): No heartbeat from core client for 30 sec - exiting 04:33:23 (4392): No heartbeat from core client for 30 sec - exiting 04:33:24 (4392): No heartbeat from core client for 30 sec - exiting 04:33:25 (4392): No heartbeat from core client for 30 sec - exiting 04:33:26 (4392): No heartbeat from core client for 30 sec - exiting 04:33:27 (4392): No heartbeat from core client for 30 sec - exiting 04:33:28 (4392): No heartbeat from core client for 30 sec - exiting 04:33:29 (4392): No heartbeat from core client for 30 sec - exiting 04:33:30 (4392): No heartbeat from core client for 30 sec - exiting 04:33:31 (4392): No heartbeat from core client for 30 sec - exiting 04:33:32 (4392): No heartbeat from core client for 30 sec - exiting 04:33:33 (4392): No heartbeat from core client for 30 sec - exiting 04:33:34 (4392): No heartbeat from core client for 30 sec - exiting 04:33:35 (4392): No heartbeat from core client for 30 sec - exiting 04:33:36 (4392): No heartbeat from core client for 30 sec - exiting 04:33:37 (4392): No heartbeat from core client for 30 sec - exiting 04:33:38 (4392): No heartbeat from core client for 30 sec - exiting 04:33:39 (4392): No heartbeat from core client for 30 sec - exiting 04:33:40 (4392): No heartbeat from core client for 30 sec - exiting 04:33:41 (4392): No heartbeat from core client for 30 sec - exiting 04:33:42 (4392): No heartbeat from core client for 30 sec - exiting 04:33:43 (4392): No heartbeat from core client for 30 sec - exiting 04:33:44 (4392): No heartbeat from core client for 30 sec - exiting 04:33:45 (4392): No heartbeat from core client for 30 sec - exiting 04:33:46 (4392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:35:32 (5488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7000, selfPID=7000, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
20 Jan 2012 06:24:18	1020546	13879860	hadam3p_eu_xoma_1993_1_006993914_1	138,336	381,817	2.7601
19 Jan 2012 21:06:37	1020546	13879860	hadam3p_eu_xoma_1993_1_006993914_1	126,816	349,320	2.7545
19 Jan 2012 11:37:21	1020546	13879860	hadam3p_eu_xoma_1993_1_006993914_1	115,296	316,721	2.7470
19 Jan 2012 01:19:58	1020546	13879860	hadam3p_eu_xoma_1993_1_006993914_1	103,776	284,932	2.7456
18 Jan 2012 15:25:49	1020546	13879860	hadam3p_eu_xoma_1993_1_006993914_1	92,256	253,452	2.7473
18 Jan 2012 06:18:38	1020546	13879860	hadam3p_eu_xoma_1993_1_006993914_1	80,736	221,722	2.7463
17 Jan 2012 21:16:17	1020546	13879860	hadam3p_eu_xoma_1993_1_006993914_1	69,216	190,341	2.7500
16 Jan 2012 03:43:32	1020546	13879860	hadam3p_eu_xoma_1993_1_006993914_1	57,696	158,834	2.7529
15 Jan 2012 07:55:18	1020546	13879860	hadam3p_eu_xoma_1993_1_006993914_1	46,176	127,641	2.7642
11 Jan 2012 00:06:53	1020546	13879860	hadam3p_eu_xoma_1993_1_006993914_1	34,656	95,794	2.7641
10 Jan 2012 12:59:22	1020546	13879860	hadam3p_eu_xoma_1993_1_006993914_1	23,136	63,932	2.7633
10 Jan 2012 01:46:46	1020546	13879860	hadam3p_eu_xoma_1993_1_006993914_1	11,616	32,426	2.7915