Task 13670492

Name	hadcm3n_o0cy_1940_40_007543107_4
Workunit	7740339
Created	29 Nov 2011, 7:43:50 UTC
Sent	30 Nov 2011, 14:01:16 UTC
Report deadline	29 Feb 2012, 21:28:27 UTC
Received	24 Feb 2012, 13:01:20 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	524107
Run time	20 days 23 hours 56 min 39 sec
CPU time	13 days 5 hours 33 min 7 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	1.40 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.6.20</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> 17:54:08 (2688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:54:10 (2688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:56:55 (3424): No heartbeat from core client for 30 sec - exiting 08:56:57 (3424): No heartbeat from core client for 30 sec - exiting 08:56:58 (3424): No heartbeat from core client for 30 sec - exiting 08:56:59 (3424): No heartbeat from core client for 30 sec - exiting 08:57:00 (3424): No heartbeat from core client for 30 sec - exiting 08:57:01 (3424): No heartbeat from core client for 30 sec - exiting 08:57:02 (3424): No heartbeat from core client for 30 sec - exiting 08:57:03 (3424): No heartbeat from core client for 30 sec - exiting 08:57:04 (3424): No heartbeat from core client for 30 sec - exiting 08:57:05 (3424): No heartbeat from core client for 30 sec - exiting 08:57:06 (3424): No heartbeat from core client for 30 sec - exiting 08:57:07 (3424): No heartbeat from core client for 30 sec - exiting 08:57:08 (3424): No heartbeat from core client for 30 sec - exiting 08:57:09 (3424): No heartbeat from core client for 30 sec - exiting 08:57:10 (3424): No heartbeat from core client for 30 sec - exiting 08:57:11 (3424): No heartbeat from core client for 30 sec - exiting 08:57:12 (3424): No heartbeat from core client for 30 sec - exiting 08:57:13 (3424): No heartbeat from core client for 30 sec - exiting 08:57:14 (3424): No heartbeat from core client for 30 sec - exiting 08:57:15 (3424): No heartbeat from core client for 30 sec - exiting 08:57:16 (3424): No heartbeat from core client for 30 sec - exiting 08:57:17 (3424): No heartbeat from core client for 30 sec - exiting 08:57:18 (3424): No heartbeat from core client for 30 sec - exiting 08:57:19 (3424): No heartbeat from core client for 30 sec - exiting 08:57:20 (3424): No heartbeat from core client for 30 sec - exiting 08:57:22 (3424): No heartbeat from core client for 30 sec - exiting 08:57:23 (3424): No heartbeat from core client for 30 sec - exiting 08:57:24 (3424): No heartbeat from core client for 30 sec - exiting 08:57:25 (3424): No heartbeat from core client for 30 sec - exiting 08:57:26 (3424): No heartbeat from core client for 30 sec - exiting 08:57:27 (3424): No heartbeat from core client for 30 sec - exiting 08:57:28 (3424): No heartbeat from core client for 30 sec - exiting 08:57:29 (3424): No heartbeat from core client for 30 sec - exiting 08:57:30 (3424): No heartbeat from core client for 30 sec - exiting 08:57:31 (3424): No heartbeat from core client for 30 sec - exiting 08:57:32 (3424): No heartbeat from core client for 30 sec - exiting 08:57:33 (3424): No heartbeat from core client for 30 sec - exiting 08:57:34 (3424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:57:35 (3424): No heartbeat from core client for 30 sec - exiting 08:57:36 (3424): No heartbeat from core client for 30 sec - exiting 08:57:37 (3424): No heartbeat from core client for 30 sec - exiting 08:57:38 (3424): No heartbeat from core client for 30 sec - exiting Ocean Restart file copy failed on o0cyko.dae13g0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Ocean Restart file copy failed on o0cyko.dae32g0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:07:32 (4224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:07:33 (4224): No heartbeat from core client for 30 sec - exiting 09:07:34 (4224): No heartbeat from core client for 30 sec - exiting 09:07:35 (4224): No heartbeat from core client for 30 sec - exiting 09:07:36 (4224): No heartbeat from core client for 30 sec - exiting 09:07:37 (4224): No heartbeat from core client for 30 sec - exiting 09:07:38 (4224): No heartbeat from core client for 30 sec - exiting 09:07:39 (4224): No heartbeat from core client for 30 sec - exiting 09:07:40 (4224): No heartbeat from core client for 30 sec - exiting 09:07:41 (4224): No heartbeat from core client for 30 sec - exiting 09:07:42 (4224): No heartbeat from core client for 30 sec - exiting 09:11:20 (3960): No heartbeat from core client for 30 sec - exiting 09:11:21 (3960): No heartbeat from core client for 30 sec - exiting 09:11:22 (3960): No heartbeat from core client for 30 sec - exiting 09:11:23 (3960): No heartbeat from core client for 30 sec - exiting 09:11:24 (3960): No heartbeat from core client for 30 sec - exiting 09:11:25 (3960): No heartbeat from core client for 30 sec - exiting 09:11:26 (3960): No heartbeat from core client for 30 sec - exiting 09:11:27 (3960): No heartbeat from core client for 30 sec - exiting 09:11:28 (3960): No heartbeat from core client for 30 sec - exiting 09:11:29 (3960): No heartbeat from core client for 30 sec - exiting 09:11:30 (3960): No heartbeat from core client for 30 sec - exiting 09:11:31 (3960): No heartbeat from core client for 30 sec - exiting 09:11:32 (3960): No heartbeat from core client for 30 sec - exiting 09:11:33 (3960): No heartbeat from core client for 30 sec - exiting 09:11:34 (3960): No heartbeat from core client for 30 sec - exiting 09:11:35 (3960): No heartbeat from core client for 30 sec - exiting 09:11:36 (3960): No heartbeat from core client for 30 sec - exiting 09:11:37 (3960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:22:33 (5796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:22:34 (5796): No heartbeat from core client for 30 sec - exiting 09:22:35 (5796): No heartbeat from core client for 30 sec - exiting 09:22:36 (5796): No heartbeat from core client for 30 sec - exiting 09:22:37 (5796): No heartbeat from core client for 30 sec - exiting 09:22:38 (5796): No heartbeat from core client for 30 sec - exiting 09:22:39 (5796): No heartbeat from core client for 30 sec - exiting 09:22:40 (5796): No heartbeat from core client for 30 sec - exiting 09:22:41 (5796): No heartbeat from core client for 30 sec - exiting 09:22:42 (5796): No heartbeat from core client for 30 sec - exiting 09:22:43 (5796): No heartbeat from core client for 30 sec - exiting 09:34:51 (2680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:34:52 (2680): No heartbeat from core client for 30 sec - exiting 09:34:53 (2680): No heartbeat from core client for 30 sec - exiting 09:34:54 (2680): No heartbeat from core client for 30 sec - exiting 09:34:55 (2680): No heartbeat from core client for 30 sec - exiting 09:34:56 (2680): No heartbeat from core client for 30 sec - exiting 09:34:57 (2680): No heartbeat from core client for 30 sec - exiting 09:34:58 (2680): No heartbeat from core client for 30 sec - exiting 09:34:59 (2680): No heartbeat from core client for 30 sec - exiting 09:35:00 (2680): No heartbeat from core client for 30 sec - exiting 09:35:01 (2680): No heartbeat from core client for 30 sec - exiting 09:47:07 (6140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:47:08 (6140): No heartbeat from core client for 30 sec - exiting 09:47:09 (6140): No heartbeat from core client for 30 sec - exiting 09:47:10 (6140): No heartbeat from core client for 30 sec - exiting 09:47:11 (6140): No heartbeat from core client for 30 sec - exiting 09:47:12 (6140): No heartbeat from core client for 30 sec - exiting 09:47:13 (6140): No heartbeat from core client for 30 sec - exiting 09:47:14 (6140): No heartbeat from core client for 30 sec - exiting 09:47:15 (6140): No heartbeat from core client for 30 sec - exiting 09:47:16 (6140): No heartbeat from core client for 30 sec - exiting 09:47:17 (6140): No heartbeat from core client for 30 sec - exiting 10:00:35 (5140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:00:36 (5140): No heartbeat from core client for 30 sec - exiting 10:00:37 (5140): No heartbeat from core client for 30 sec - exiting 10:00:38 (5140): No heartbeat from core client for 30 sec - exiting 10:00:39 (5140): No heartbeat from core client for 30 sec - exiting 10:00:40 (5140): No heartbeat from core client for 30 sec - exiting 10:00:41 (5140): No heartbeat from core client for 30 sec - exiting 10:00:42 (5140): No heartbeat from core client for 30 sec - exiting 10:00:43 (5140): No heartbeat from core client for 30 sec - exiting 10:00:44 (5140): No heartbeat from core client for 30 sec - exiting 10:00:45 (5140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Ocean Restart file copy failed on o0cyko.dae56h0 CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3936, selfPID=3936, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Ocean Restart file copy failed on o0cyko.daf01g0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Ocean Restart file copy failed on o0cyko.daf0460 Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
24 Feb 2012 13:03:32	524107	13670492	hadcm3n_o0cy_1940_40_007543107_4	259,200	1,143,176	4.4104
17 Feb 2012 16:23:59	524107	13670492	hadcm3n_o0cy_1940_40_007543107_4	233,280	1,027,549	4.4048
03 Feb 2012 19:45:54	524107	13670492	hadcm3n_o0cy_1940_40_007543107_4	207,360	909,894	4.3880
27 Jan 2012 14:41:14	524107	13670492	hadcm3n_o0cy_1940_40_007543107_4	181,440	791,380	4.3617
20 Jan 2012 12:10:37	524107	13670492	hadcm3n_o0cy_1940_40_007543107_4	155,520	678,911	4.3654
11 Jan 2012 18:57:53	524107	13670492	hadcm3n_o0cy_1940_40_007543107_4	129,600	562,673	4.3416
04 Jan 2012 14:57:37	524107	13670492	hadcm3n_o0cy_1940_40_007543107_4	103,680	451,343	4.3532
22 Dec 2011 19:03:11	524107	13670492	hadcm3n_o0cy_1940_40_007543107_4	77,760	337,642	4.3421
15 Dec 2011 17:33:30	524107	13670492	hadcm3n_o0cy_1940_40_007543107_4	51,840	230,258	4.4417
09 Dec 2011 15:14:13	524107	13670492	hadcm3n_o0cy_1940_40_007543107_4	25,920	111,513	4.3022