Task 13535193

Name	hadcm3n_yjnq_1900_40_007514764_0
Workunit	7712239
Created	28 Oct 2011, 12:38:33 UTC
Sent	24 Nov 2011, 13:21:18 UTC
Report deadline	23 Feb 2012, 20:48:29 UTC
Received	28 Feb 2012, 21:22:44 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1101171
Run time	27 days 8 hours 6 min 59 sec
CPU time	23 days 1 hours 47 min 37 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	2.43 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 21:35:54 (3060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:50:39 (7176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:01:08 (7512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:59:44 (6256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:59:49 (6256): No heartbeat from core client for 30 sec - exiting 19:59:50 (6256): No heartbeat from core client for 30 sec - exiting 19:59:51 (6256): No heartbeat from core client for 30 sec - exiting 19:59:52 (6256): No heartbeat from core client for 30 sec - exiting 19:59:53 (6256): No heartbeat from core client for 30 sec - exiting 19:59:54 (6256): No heartbeat from core client for 30 sec - exiting 19:59:55 (6256): No heartbeat from core client for 30 sec - exiting 19:59:56 (6256): No heartbeat from core client for 30 sec - exiting 19:59:57 (6256): No heartbeat from core client for 30 sec - exiting 19:59:58 (6256): No heartbeat from core client for 30 sec - exiting 19:59:59 (6256): No heartbeat from core client for 30 sec - exiting 20:00:00 (6256): No heartbeat from core client for 30 sec - exiting 20:00:01 (6256): No heartbeat from core client for 30 sec - exiting 20:00:02 (6256): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7076, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7076, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 08:35:35 (6408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:35:40 (6408): No heartbeat from core client for 30 sec - exiting 08:35:41 (6408): No heartbeat from core client for 30 sec - exiting 08:35:42 (6408): No heartbeat from core client for 30 sec - exiting 08:35:43 (6408): No heartbeat from core client for 30 sec - exiting 08:35:44 (6408): No heartbeat from core client for 30 sec - exiting 08:35:45 (6408): No heartbeat from core client for 30 sec - exiting 08:35:46 (6408): No heartbeat from core client for 30 sec - exiting 08:35:47 (6408): No heartbeat from core client for 30 sec - exiting 08:35:48 (6408): No heartbeat from core client for 30 sec - exiting 08:35:49 (6408): No heartbeat from core client for 30 sec - exiting 08:35:50 (6408): No heartbeat from core client for 30 sec - exiting 08:35:51 (6408): No heartbeat from core client for 30 sec - exiting 08:35:52 (6408): No heartbeat from core client for 30 sec - exiting 08:35:53 (6408): No heartbeat from core client for 30 sec - exiting 08:35:54 (6408): No heartbeat from core client for 30 sec - exiting 08:35:55 (6408): No heartbeat from core client for 30 sec - exiting 08:35:56 (6408): No heartbeat from core client for 30 sec - exiting 08:35:57 (6408): No heartbeat from core client for 30 sec - exiting 09:03:17 (2052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:03:18 (2052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 19:41:44 (7032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:42:10 (7032): No heartbeat from core client for 30 sec - exiting 19:42:11 (7032): No heartbeat from core client for 30 sec - exiting 19:42:12 (7032): No heartbeat from core client for 30 sec - exiting 19:42:13 (7032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:39:52 (9636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 21:59:55 (7624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 15:05:36 (7464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:11:44 (1036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 18:33:17 (4148): No heartbeat from core client for 30 sec - exiting 18:33:22 (4148): No heartbeat from core client for 30 sec - exiting 18:33:23 (4148): No heartbeat from core client for 30 sec - exiting 18:33:24 (4148): No heartbeat from core client for 30 sec - exiting 18:33:25 (4148): No heartbeat from core client for 30 sec - exiting 18:33:26 (4148): No heartbeat from core client for 30 sec - exiting 18:33:27 (4148): No heartbeat from core client for 30 sec - exiting 18:33:28 (4148): No heartbeat from core client for 30 sec - exiting 18:33:29 (4148): No heartbeat from core client for 30 sec - exiting 18:33:30 (4148): No heartbeat from core client for 30 sec - exiting 18:33:31 (4148): No heartbeat from core client for 30 sec - exiting 18:33:32 (4148): No heartbeat from core client for 30 sec - exiting 18:33:33 (4148): No heartbeat from core client for 30 sec - exiting 18:33:34 (4148): No heartbeat from core client for 30 sec - exiting 18:33:35 (4148): No heartbeat from core client for 30 sec - exiting 18:33:36 (4148): No heartbeat from core client for 30 sec - exiting 18:33:37 (4148): No heartbeat from core client for 30 sec - exiting 18:33:38 (4148): No heartbeat from core client for 30 sec - exiting 18:33:39 (4148): No heartbeat from core client for 30 sec - exiting 18:33:40 (4148): No heartbeat from core client for 30 sec - exiting 18:33:41 (4148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:20:20 (716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:20:24 (716): No heartbeat from core client for 30 sec - exiting 19:20:25 (716): No heartbeat from core client for 30 sec - exiting 19:20:26 (716): No heartbeat from core client for 30 sec - exiting 19:20:27 (716): No heartbeat from core client for 30 sec - exiting 19:20:28 (716): No heartbeat from core client for 30 sec - exiting 19:20:29 (716): No heartbeat from core client for 30 sec - exiting 19:20:30 (716): No heartbeat from core client for 30 sec - exiting 19:20:31 (716): No heartbeat from core client for 30 sec - exiting 19:20:33 (716): No heartbeat from core client for 30 sec - exiting 19:20:34 (716): No heartbeat from core client for 30 sec - exiting 19:20:35 (716): No heartbeat from core client for 30 sec - exiting 19:20:36 (716): No heartbeat from core client for 30 sec - exiting 19:20:37 (716): No heartbeat from core client for 30 sec - exiting 01:21:52 (4276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:53:16 (5520): No heartbeat from core client for 30 sec - exiting 08:53:17 (5520): No heartbeat from core client for 30 sec - exiting 08:53:18 (5520): No heartbeat from core client for 30 sec - exiting 08:53:19 (5520): No heartbeat from core client for 30 sec - exiting 08:53:20 (5520): No heartbeat from core client for 30 sec - exiting 08:53:21 (5520): No heartbeat from core client for 30 sec - exiting 08:53:22 (5520): No heartbeat from core client for 30 sec - exiting 08:53:23 (5520): No heartbeat from core client for 30 sec - exiting 08:53:24 (5520): No heartbeat from core client for 30 sec - exiting 08:53:25 (5520): No heartbeat from core client for 30 sec - exiting 08:53:26 (5520): No heartbeat from core client for 30 sec - exiting 08:53:27 (5520): No heartbeat from core client for 30 sec - exiting 08:53:28 (5520): No heartbeat from core client for 30 sec - exiting 08:53:29 (5520): No heartbeat from core client for 30 sec - exiting 08:53:30 (5520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 14:57:31 (7728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:53:04 (2540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:53:40 (2540): No heartbeat from core client for 30 sec - exiting 17:53:41 (2540): No heartbeat from core client for 30 sec - exiting 17:53:42 (2540): No heartbeat from core client for 30 sec - exiting 17:53:43 (2540): No heartbeat from core client for 30 sec - exiting 17:53:44 (2540): No heartbeat from core client for 30 sec - exiting 17:53:45 (2540): No heartbeat from core client for 30 sec - exiting 17:53:46 (2540): No heartbeat from core client for 30 sec - exiting 17:53:47 (2540): No heartbeat from core client for 30 sec - exiting 17:53:48 (2540): No heartbeat from core client for 30 sec - exiting 17:53:49 (2540): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:38:54 (3260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:52:45 (6332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:53:47 (5848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:54:47 (5848): No heartbeat from core client for 30 sec - exiting 13:56:07 (5472): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... 20:38:41 (6460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:38:42 (6460): No heartbeat from core client for 30 sec - exiting 20:38:43 (6460): No heartbeat from core client for 30 sec - exiting 20:38:44 (6460): No heartbeat from core client for 30 sec - exiting 20:38:45 (6460): No heartbeat from core client for 30 sec - exiting 20:38:46 (6460): No heartbeat from core client for 30 sec - exiting 20:38:47 (6460): No heartbeat from core client for 30 sec - exiting 20:38:48 (6460): No heartbeat from core client for 30 sec - exiting 20:38:49 (6460): No heartbeat from core client for 30 sec - exiting 20:38:50 (6460): No heartbeat from core client for 30 sec - exiting 20:38:51 (6460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 19:51:53 (2480): No heartbeat from core client for 30 sec - exiting 19:51:55 (2480): No heartbeat from core client for 30 sec - exiting 19:51:56 (2480): No heartbeat from core client for 30 sec - exiting 19:51:57 (2480): No heartbeat from core client for 30 sec - exiting 19:51:58 (2480): No heartbeat from core client for 30 sec - exiting 19:51:59 (2480): No heartbeat from core client for 30 sec - exiting 19:52:00 (2480): No heartbeat from core client for 30 sec - exiting 19:52:01 (2480): No heartbeat from core client for 30 sec - exiting 19:52:02 (2480): No heartbeat from core client for 30 sec - exiting 19:52:03 (2480): No heartbeat from core client for 30 sec - exiting 19:52:04 (2480): No heartbeat from core client for 30 sec - exiting 19:52:05 (2480): No heartbeat from core client for 30 sec - exiting 19:52:06 (2480): No heartbeat from core client for 30 sec - exiting 19:52:07 (2480): No heartbeat from core client for 30 sec - exiting 19:52:08 (2480): No heartbeat from core client for 30 sec - exiting 19:52:09 (2480): No heartbeat from core client for 30 sec - exiting 19:52:10 (2480): No heartbeat from core client for 30 sec - exiting 19:52:11 (2480): No heartbeat from core client for 30 sec - exiting 19:52:12 (2480): No heartbeat from core client for 30 sec - exiting 19:52:13 (2480): No heartbeat from core client for 30 sec - exiting 19:52:14 (2480): No heartbeat from core client for 30 sec - exiting 19:52:15 (2480): No heartbeat from core client for 30 sec - exiting 19:52:16 (2480): No heartbeat from core client for 30 sec - exiting 19:52:17 (2480): No heartbeat from core client for 30 sec - exiting 19:52:18 (2480): No heartbeat from core client for 30 sec - exiting 19:52:19 (2480): No heartbeat from core client for 30 sec - exiting 19:52:20 (2480): No heartbeat from core client for 30 sec - exiting 19:52:21 (2480): No heartbeat from core client for 30 sec - exiting 19:52:22 (2480): No heartbeat from core client for 30 sec - exiting 19:52:23 (2480): No heartbeat from core client for 30 sec - exiting 19:52:24 (2480): No heartbeat from core client for 30 sec - exiting 19:52:25 (2480): No heartbeat from core client for 30 sec - exiting 19:52:26 (2480): No heartbeat from core client for 30 sec - exiting 19:52:27 (2480): No heartbeat from core client for 30 sec - exiting 19:52:28 (2480): No heartbeat from core client for 30 sec - exiting 19:52:29 (2480): No heartbeat from core client for 30 sec - exiting 19:52:30 (2480): No heartbeat from core client for 30 sec - exiting 19:52:31 (2480): No heartbeat from core client for 30 sec - exiting 19:52:32 (2480): No heartbeat from core client for 30 sec - exiting 19:52:33 (2480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:14:45 (12048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:33:08 (7972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 12:52:11 (4196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
28 Feb 2012 20:26:43	1101171	13535193	hadcm3n_yjnq_1900_40_007514764_0	777,600	1,993,643	2.5638
24 Feb 2012 12:22:41	1101171	13535193	hadcm3n_yjnq_1900_40_007514764_0	751,680	1,921,889	2.5568
21 Feb 2012 15:46:26	1101171	13535193	hadcm3n_yjnq_1900_40_007514764_0	725,760	1,848,973	2.5476
16 Feb 2012 20:24:58	1101171	13535193	hadcm3n_yjnq_1900_40_007514764_0	699,840	1,778,005	2.5406
16 Feb 2012 00:14:03	1101171	13535193	hadcm3n_yjnq_1900_40_007514764_0	673,920	1,711,858	2.5402
14 Feb 2012 13:42:01	1101171	13535193	hadcm3n_yjnq_1900_40_007514764_0	648,000	1,641,815	2.5337
13 Feb 2012 18:03:34	1101171	13535193	hadcm3n_yjnq_1900_40_007514764_0	622,080	1,575,855	2.5332
01 Feb 2012 04:20:12	1101171	13535193	hadcm3n_yjnq_1900_40_007514764_0	596,160	1,508,659	2.5306
30 Jan 2012 16:13:40	1101171	13535193	hadcm3n_yjnq_1900_40_007514764_0	570,240	1,440,476	2.5261
29 Jan 2012 22:27:22	1101171	13535193	hadcm3n_yjnq_1900_40_007514764_0	544,320	1,376,191	2.5283
29 Jan 2012 03:21:48	1101171	13535193	hadcm3n_yjnq_1900_40_007514764_0	518,400	1,313,390	2.5335
28 Jan 2012 08:27:33	1101171	13535193	hadcm3n_yjnq_1900_40_007514764_0	492,480	1,247,401	2.5329
19 Jan 2012 10:47:08	1101171	13535193	hadcm3n_yjnq_1900_40_007514764_0	466,560	1,181,694	2.5328
18 Jan 2012 11:04:41	1101171	13535193	hadcm3n_yjnq_1900_40_007514764_0	440,640	1,119,285	2.5401
17 Jan 2012 11:48:55	1101171	13535193	hadcm3n_yjnq_1900_40_007514764_0	414,720	1,056,077	2.5465
15 Jan 2012 20:25:39	1101171	13535193	hadcm3n_yjnq_1900_40_007514764_0	388,800	995,662	2.5609
14 Jan 2012 23:18:28	1101171	13535193	hadcm3n_yjnq_1900_40_007514764_0	362,880	936,341	2.5803
14 Jan 2012 00:30:18	1101171	13535193	hadcm3n_yjnq_1900_40_007514764_0	336,960	873,348	2.5918
10 Jan 2012 12:59:22	1101171	13535193	hadcm3n_yjnq_1900_40_007514764_0	311,040	808,129	2.5982
22 Dec 2011 22:58:15	1101171	13535193	hadcm3n_yjnq_1900_40_007514764_0	285,120	741,122	2.5993