Task 13293339

Name	hadcm3n_p19g_1940_40_007422340_1
Workunit	7619975
Created	25 Aug 2011, 5:31:38 UTC
Sent	25 Aug 2011, 5:37:14 UTC
Report deadline	24 Nov 2011, 13:04:25 UTC
Received	6 Sep 2011, 23:24:42 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	1 (0x00000001) Unknown error code
Computer ID	1165675
Run time	4 days 18 hours 6 min 46 sec
CPU time	3 days 22 hours 8 min 22 sec
Validate state	Invalid
Credit	2,488.32
Device peak FLOPS	2.43 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> Incorrect function. (0x1) - exit code 1 (0x1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:30:46 (138992): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 19:18:14 (1824): No heartbeat from core client for 30 sec - exiting 19:18:16 (1824): No heartbeat from core client for 30 sec - exiting 19:18:17 (1824): No heartbeat from core client for 30 sec - exiting 19:18:18 (1824): No heartbeat from core client for 30 sec - exiting 19:18:19 (1824): No heartbeat from core client for 30 sec - exiting 19:18:20 (1824): No heartbeat from core client for 30 sec - exiting 19:18:21 (1824): No heartbeat from core client for 30 sec - exiting 19:18:22 (1824): No heartbeat from core client for 30 sec - exiting 19:18:23 (1824): No heartbeat from core client for 30 sec - exiting 19:18:24 (1824): No heartbeat from core client for 30 sec - exiting 19:18:25 (1824): No heartbeat from core client for 30 sec - exiting 19:18:26 (1824): No heartbeat from core client for 30 sec - exiting 19:18:28 (1824): No heartbeat from core client for 30 sec - exiting 19:18:29 (1824): No heartbeat from core client for 30 sec - exiting 19:18:30 (1824): No heartbeat from core client for 30 sec - exiting 19:18:31 (1824): No heartbeat from core client for 30 sec - exiting 19:18:32 (1824): No heartbeat from core client for 30 sec - exiting 19:18:33 (1824): No heartbeat from core client for 30 sec - exiting 19:18:34 (1824): No heartbeat from core client for 30 sec - exiting 19:18:35 (1824): No heartbeat from core client for 30 sec - exiting 19:18:36 (1824): No heartbeat from core client for 30 sec - exiting 19:18:37 (1824): No heartbeat from core client for 30 sec - exiting 19:18:38 (1824): No heartbeat from core client for 30 sec - exiting 19:18:40 (1824): No heartbeat from core client for 30 sec - exiting 19:18:41 (1824): No heartbeat from core client for 30 sec - exiting 19:18:42 (1824): No heartbeat from core client for 30 sec - exiting 19:18:43 (1824): No heartbeat from core client for 30 sec - exiting 19:18:44 (1824): No heartbeat from core client for 30 sec - exiting 19:18:45 (1824): No heartbeat from core client for 30 sec - exiting 19:18:46 (1824): No heartbeat from core client for 30 sec - exiting 19:18:47 (1824): No heartbeat from core client for 30 sec - exiting 19:18:48 (1824): No heartbeat from core client for 30 sec - exiting 19:18:49 (1824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 09:41:37 (4540): No heartbeat from core client for 30 sec - exiting 09:41:38 (4540): No heartbeat from core client for 30 sec - exiting 09:41:39 (4540): No heartbeat from core client for 30 sec - exiting 09:41:40 (4540): No heartbeat from core client for 30 sec - exiting 09:41:41 (4540): No heartbeat from core client for 30 sec - exiting 09:41:42 (4540): No heartbeat from core client for 30 sec - exiting 09:41:43 (4540): No heartbeat from core client for 30 sec - exiting 09:41:44 (4540): No heartbeat from core client for 30 sec - exiting 09:41:45 (4540): No heartbeat from core client for 30 sec - exiting 09:41:47 (4540): No heartbeat from core client for 30 sec - exiting 09:41:48 (4540): No heartbeat from core client for 30 sec - exiting 09:41:49 (4540): No heartbeat from core client for 30 sec - exiting 09:41:50 (4540): No heartbeat from core client for 30 sec - exiting 09:41:51 (4540): No heartbeat from core client for 30 sec - exiting 09:41:52 (4540): No heartbeat from core client for 30 sec - exiting 09:41:53 (4540): No heartbeat from core client for 30 sec - exiting 09:41:54 (4540): No heartbeat from core client for 30 sec - exiting 09:41:55 (4540): No heartbeat from core client for 30 sec - exiting 09:41:56 (4540): No heartbeat from core client for 30 sec - exiting 09:41:57 (4540): No heartbeat from core client for 30 sec - exiting 09:41:59 (4540): No heartbeat from core client for 30 sec - exiting 09:42:00 (4540): No heartbeat from core client for 30 sec - exiting 09:42:01 (4540): No heartbeat from core client for 30 sec - exiting 09:42:02 (4540): No heartbeat from core client for 30 sec - exiting 09:42:03 (4540): No heartbeat from core client for 30 sec - exiting 09:42:04 (4540): No heartbeat from core client for 30 sec - exiting 09:42:05 (4540): No heartbeat from core client for 30 sec - exiting 09:42:06 (4540): No heartbeat from core client for 30 sec - exiting 09:42:07 (4540): No heartbeat from core client for 30 sec - exiting 09:42:08 (4540): No heartbeat from core client for 30 sec - exiting 09:42:10 (4540): No heartbeat from core client for 30 sec - exiting 09:42:11 (4540): No heartbeat from core client for 30 sec - exiting 09:42:12 (4540): No heartbeat from core client for 30 sec - exiting 09:42:13 (4540): No heartbeat from core client for 30 sec - exiting 09:42:14 (4540): No heartbeat from core client for 30 sec - exiting 09:42:15 (4540): No heartbeat from core client for 30 sec - exiting 09:42:16 (4540): No heartbeat from core client for 30 sec - exiting 09:42:17 (4540): No heartbeat from core client for 30 sec - exiting 09:42:18 (4540): No heartbeat from core client for 30 sec - exiting 09:42:19 (4540): No heartbeat from core client for 30 sec - exiting 09:42:20 (4540): No heartbeat from core client for 30 sec - exiting 09:42:22 (4540): No heartbeat from core client for 30 sec - exiting 09:42:23 (4540): No heartbeat from core client for 30 sec - exiting 09:42:24 (4540): No heartbeat from core client for 30 sec - exiting 09:42:25 (4540): No heartbeat from core client for 30 sec - exiting 09:42:26 (4540): No heartbeat from core client for 30 sec - exiting 09:42:27 (4540): No heartbeat from core client for 30 sec - exiting 09:42:28 (4540): No heartbeat from core client for 30 sec - exiting 09:42:29 (4540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4808, iMonCtr=1 Model crash detected, will try to restart... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Sep 2011 08:55:24	1165675	13293339	hadcm3n_p19g_1940_40_007422340_1	207,360	308,402	1.4873
05 Sep 2011 14:39:41	1165675	13293339	hadcm3n_p19g_1940_40_007422340_1	181,440	269,609	1.4859
04 Sep 2011 19:21:33	1165675	13293339	hadcm3n_p19g_1940_40_007422340_1	155,520	231,524	1.4887
03 Sep 2011 16:28:42	1165675	13293339	hadcm3n_p19g_1940_40_007422340_1	129,600	192,708	1.4869
02 Sep 2011 13:21:53	1165675	13293339	hadcm3n_p19g_1940_40_007422340_1	103,680	154,277	1.4880
30 Aug 2011 05:50:44	1165675	13293339	hadcm3n_p19g_1940_40_007422340_1	77,760	116,258	1.4951
28 Aug 2011 15:23:01	1165675	13293339	hadcm3n_p19g_1940_40_007422340_1	51,840	77,845	1.5016
26 Aug 2011 14:25:31	1165675	13293339	hadcm3n_p19g_1940_40_007422340_1	25,920	38,953	1.5028