Task 14652746

Name	hadcm3n_o02p_1980_40_007958885_1
Workunit	8113997
Created	9 May 2012, 23:07:17 UTC
Sent	9 May 2012, 23:48:28 UTC
Report deadline	9 Aug 2012, 7:15:39 UTC
Received	15 Jul 2012, 22:43:39 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1207199
Run time	4 days 13 hours 26 min 11 sec
CPU time	3 days 16 hours 47 min 48 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	3.33 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.25</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:38:37 (7760): Can't acquire lockfile (32) - waiting 35s 12:39:02 (6376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:43:54 (4640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:43:55 (4640): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 07:51:42 (6012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:15:32 (2240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:15:33 (2240): No heartbeat from core client for 30 sec - exiting 18:18:54 (2264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:18:55 (2264): No heartbeat from core client for 30 sec - exiting 18:18:56 (2264): No heartbeat from core client for 30 sec - exiting 18:18:57 (2264): No heartbeat from core client for 30 sec - exiting 18:18:58 (2264): No heartbeat from core client for 30 sec - exiting 18:18:59 (2264): No heartbeat from core client for 30 sec - exiting 18:19:00 (2264): No heartbeat from core client for 30 sec - exiting 18:19:01 (2264): No heartbeat from core client for 30 sec - exiting 18:19:02 (2264): No heartbeat from core client for 30 sec - exiting 18:19:03 (2264): No heartbeat from core client for 30 sec - exiting 18:19:04 (2264): No heartbeat from core client for 30 sec - exiting 18:20:05 (2328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:20:06 (2328): No heartbeat from core client for 30 sec - exiting 18:20:07 (2328): No heartbeat from core client for 30 sec - exiting 18:20:08 (2328): No heartbeat from core client for 30 sec - exiting 18:20:09 (2328): No heartbeat from core client for 30 sec - exiting 18:20:10 (2328): No heartbeat from core client for 30 sec - exiting 18:20:11 (2328): No heartbeat from core client for 30 sec - exiting 18:20:12 (2328): No heartbeat from core client for 30 sec - exiting 18:20:13 (2328): No heartbeat from core client for 30 sec - exiting 18:33:51 (3324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:33:52 (3324): No heartbeat from core client for 30 sec - exiting 18:33:53 (3324): No heartbeat from core client for 30 sec - exiting 18:33:54 (3324): No heartbeat from core client for 30 sec - exiting 18:33:55 (3324): No heartbeat from core client for 30 sec - exiting 18:33:56 (3324): No heartbeat from core client for 30 sec - exiting 18:33:57 (3324): No heartbeat from core client for 30 sec - exiting 18:33:58 (3324): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:59:34 (4200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:59:35 (4200): No heartbeat from core client for 30 sec - exiting 09:59:36 (4200): No heartbeat from core client for 30 sec - exiting 10:01:18 (4940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:30:44 (5556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:30:48 (5556): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:44:32 (5580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:44:35 (5580): No heartbeat from core client for 30 sec - exiting 12:44:36 (5580): No heartbeat from core client for 30 sec - exiting 12:44:37 (5580): No heartbeat from core client for 30 sec - exiting 12:44:38 (5580): No heartbeat from core client for 30 sec - exiting 12:44:39 (5580): No heartbeat from core client for 30 sec - exiting 12:44:40 (5580): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:05:56 (4476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:34:21 (332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:34:26 (332): No heartbeat from core client for 30 sec - exiting 07:34:27 (332): No heartbeat from core client for 30 sec - exiting 07:34:28 (332): No heartbeat from core client for 30 sec - exiting 07:34:29 (332): No heartbeat from core client for 30 sec - exiting 07:34:30 (332): No heartbeat from core client for 30 sec - exiting 07:34:31 (332): No heartbeat from core client for 30 sec - exiting 07:34:32 (332): No heartbeat from core client for 30 sec - exiting 07:37:40 (5428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:37:41 (5428): No heartbeat from core client for 30 sec - exiting 07:37:42 (5428): No heartbeat from core client for 30 sec - exiting 07:37:43 (5428): No heartbeat from core client for 30 sec - exiting 07:37:44 (5428): No heartbeat from core client for 30 sec - exiting 07:37:45 (5428): No heartbeat from core client for 30 sec - exiting 07:37:46 (5428): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold Suspended CPDN Monitor - Suspend request from BOINC... 08:12:58 (5804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:15:53 (4840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:15:54 (4840): No heartbeat from core client for 30 sec - exiting 08:15:55 (4840): No heartbeat from core client for 30 sec - exiting 08:15:56 (4840): No heartbeat from core client for 30 sec - exiting 08:15:57 (4840): No heartbeat from core client for 30 sec - exiting 08:15:58 (4840): No heartbeat from core client for 30 sec - exiting 08:15:59 (4840): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:57:09 (4708): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 17:57:11 (4708): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:52:36 (7796): Can't acquire lockfile (32) - waiting 35s 16:52:41 (8140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:55:03 (7796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:55:04 (7796): No heartbeat from core client for 30 sec - exiting 16:55:05 (7796): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:20:57 (6088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:21:49 (3800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:24:15 (3768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:24:16 (3768): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 10:21:52 (5788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 Jul 2012 22:43:50	1207199	14652746	hadcm3n_o02p_1980_40_007958885_1	259,200	319,666	1.2333
08 Jul 2012 22:47:56	1207199	14652746	hadcm3n_o02p_1980_40_007958885_1	233,280	287,821	1.2338
04 Jul 2012 14:22:55	1207199	14652746	hadcm3n_o02p_1980_40_007958885_1	207,360	257,617	1.2424
26 Jun 2012 00:35:44	1207199	14652746	hadcm3n_o02p_1980_40_007958885_1	181,440	225,285	1.2417
21 Jun 2012 00:58:07	1207199	14652746	hadcm3n_o02p_1980_40_007958885_1	155,520	193,130	1.2418
16 Jun 2012 14:10:42	1207199	14652746	hadcm3n_o02p_1980_40_007958885_1	129,600	161,026	1.2425
05 Jun 2012 22:28:21	1207199	14652746	hadcm3n_o02p_1980_40_007958885_1	103,680	128,798	1.2423
02 Jun 2012 19:48:33	1207199	14652746	hadcm3n_o02p_1980_40_007958885_1	77,760	96,356	1.2391
20 May 2012 14:59:49	1207199	14652746	hadcm3n_o02p_1980_40_007958885_1	51,840	64,497	1.2442
14 May 2012 00:12:41	1207199	14652746	hadcm3n_o02p_1980_40_007958885_1	25,920	32,246	1.2441