Task 16875331

Name	hadcm3s_1aoa_1990_2_008918116_0
Workunit	9062291
Created	19 Aug 2014, 9:09:43 UTC
Sent	3 Sep 2014, 12:17:05 UTC
Report deadline	3 Dec 2014, 19:44:16 UTC
Received	26 Sep 2014, 12:50:53 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	9 (0x00000009) Unknown error code
Computer ID	1170047
Run time	1 days 18 hours 54 min 32 sec
CPU time	1 days 17 hours 9 min 57 sec
Validate state	Invalid
Credit	622.08
Device peak FLOPS	2.68 GFLOPS
Application version	UK Met Office HadCM3 short v7.24 i686-apple-darwin
Stderr	<core_client_version>6.10.21</core_client_version> <![CDATA[ <message> process exited with code 9 (0x9, -247) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 10:00:12 (33053): No heartbeat from client for 30 sec - exiting 10:00:13 (33053): timer handler: client dead, exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:01:13 (76150): No heartbeat from client for 30 sec - exiting 04:01:14 (76150): timer handler: client dead, exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:13:38 (12267): No heartbeat from client for 30 sec - exiting 07:13:40 (12267): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:13:41 (12267): No heartbeat from client for 30 sec - exiting 07:13:41 (12267): timer handler: client dead, exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:47:54 (37954): No heartbeat from client for 30 sec - exiting 20:47:55 (37954): timer handler: client dead, exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 19:57:19 (82261): No heartbeat from client for 30 sec - exiting 19:57:22 (82261): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:56:04 (82623): No heartbeat from client for 30 sec - exiting 21:56:05 (82623): timer handler: client dead, exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 22:59:28 (83908): No heartbeat from client for 30 sec - exiting 22:59:28 (83908): timer handler: client dead, exiting 22:59:29 (83908): No heartbeat from client for 30 sec - exiting 22:59:29 (83908): timer handler: client dead, exiting 22:59:30 (83908): No heartbeat from client for 30 sec - exiting 22:59:30 (83908): timer handler: client dead, exiting 22:59:31 (83908): No heartbeat from client for 30 sec - exiting 22:59:31 (83908): timer handler: client dead, exiting 22:59:32 (83908): No heartbeat from client for 30 sec - exiting 22:59:32 (83908): timer handler: client dead, exiting 22:59:33 (83908): No heartbeat from client for 30 sec - exiting 22:59:33 (83908): timer handler: client dead, exiting 22:59:34 (83908): No heartbeat from client for 30 sec - exiting 22:59:34 (83908): timer handler: client dead, exiting 22:59:35 (83908): No heartbeat from client for 30 sec - exiting 22:59:35 (83908): timer handler: client dead, exiting 22:59:36 (83908): No heartbeat from client for 30 sec - exiting 22:59:36 (83908): timer handler: client dead, exiting 22:59:37 (83908): No heartbeat from client for 30 sec - exiting 22:59:37 (83908): timer handler: client dead, exiting 22:59:38 (83908): No heartbeat from client for 30 sec - exiting 22:59:38 (83908): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:02:20 (83913): No heartbeat from client for 30 sec - exiting 23:02:23 (83913): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:03:33 (83985): No heartbeat from client for 30 sec - exiting 23:03:33 (83985): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:06:43 (84001): No heartbeat from client for 30 sec - exiting 23:06:44 (84001): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:06:45 (84001): No heartbeat from client for 30 sec - exiting 23:06:45 (84001): timer handler: client dead, exiting 23:06:46 (84001): No heartbeat from client for 30 sec - exiting 23:06:46 (84001): timer handler: client dead, exiting 23:06:48 (84001): No heartbeat from client for 30 sec - exiting 23:06:48 (84001): timer handler: client dead, exiting 23:06:49 (84001): No heartbeat from client for 30 sec - exiting 23:06:49 (84001): timer handler: client dead, exiting 23:06:50 (84001): No heartbeat from client for 30 sec - exiting 23:06:50 (84001): timer handler: client dead, exiting 23:06:51 (84001): No heartbeat from client for 30 sec - exiting 23:06:51 (84001): timer handler: client dead, exiting 23:06:52 (84001): No heartbeat from client for 30 sec - exiting 23:06:52 (84001): timer handler: client dead, exiting 23:06:53 (84001): No heartbeat from client for 30 sec - exiting 23:06:53 (84001): timer handler: client dead, exiting 23:08:32 (84069): No heartbeat from client for 30 sec - exiting 23:08:33 (84069): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:10:10 (84098): No heartbeat from client for 30 sec - exiting 23:10:13 (84098): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:11:50 (84154): No heartbeat from client for 30 sec - exiting 23:11:53 (84154): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:13:29 (84179): No heartbeat from client for 30 sec - exiting 23:13:31 (84179): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:15:09 (84237): No heartbeat from client for 30 sec - exiting 23:15:10 (84237): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:16:43 (84262): No heartbeat from client for 30 sec - exiting 23:16:43 (84262): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... SIGSEGV: segmentation violation 23:18:26 (84328): No heartbeat from client for 30 sec - exiting 23:18:28 (84328): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:20:05 (84351): No heartbeat from client for 30 sec - exiting 23:20:06 (84351): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:21:41 (84408): No heartbeat from client for 30 sec - exiting 23:21:43 (84408): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:23:16 (84436): No heartbeat from client for 30 sec - exiting 23:23:18 (84436): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:24:53 (84495): No heartbeat from client for 30 sec - exiting 23:24:55 (84495): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:26:32 (84517): No heartbeat from client for 30 sec - exiting 23:26:33 (84517): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:28:07 (84576): No heartbeat from client for 30 sec - exiting 23:28:08 (84576): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:29:45 (84601): No heartbeat from client for 30 sec - exiting 23:29:45 (84601): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:31:19 (84661): No heartbeat from client for 30 sec - exiting 23:31:22 (84661): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:32:55 (84683): No heartbeat from client for 30 sec - exiting 23:32:56 (84683): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:34:28 (84743): No heartbeat from client for 30 sec - exiting 23:34:28 (84743): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:36:03 (84766): No heartbeat from client for 30 sec - exiting 23:36:04 (84766): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:37:41 (84822): No heartbeat from client for 30 sec - exiting 23:37:42 (84822): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:37:43 (84822): No heartbeat from client for 30 sec - exiting 23:37:43 (84822): timer handler: client dead, exiting 23:39:18 (84849): No heartbeat from client for 30 sec - exiting 23:39:18 (84849): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:40:52 (84906): No heartbeat from client for 30 sec - exiting 23:40:52 (84906): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:42:26 (84931): No heartbeat from client for 30 sec - exiting 23:42:27 (84931): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:44:00 (84988): No heartbeat from client for 30 sec - exiting 23:44:02 (84988): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:45:36 (85015): No heartbeat from client for 30 sec - exiting 23:45:37 (85015): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:47:12 (85071): No heartbeat from client for 30 sec - exiting 23:47:13 (85071): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:48:47 (85096): No heartbeat from client for 30 sec - exiting 23:48:48 (85096): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:50:20 (85151): No heartbeat from client for 30 sec - exiting 23:50:21 (85151): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:51:54 (85179): No heartbeat from client for 30 sec - exiting 23:51:55 (85179): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:53:28 (85233): No heartbeat from client for 30 sec - exiting 23:53:30 (85233): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:55:01 (85260): No heartbeat from client for 30 sec - exiting 23:55:02 (85260): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:56:36 (85322): No heartbeat from client for 30 sec - exiting 23:56:37 (85322): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:58:09 (85346): No heartbeat from client for 30 sec - exiting 23:58:10 (85346): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:59:41 (85404): No heartbeat from client for 30 sec - exiting 23:59:45 (85404): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:01:18 (85429): No heartbeat from client for 30 sec - exiting 00:01:19 (85429): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:02:51 (85491): No heartbeat from client for 30 sec - exiting 00:02:52 (85491): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:47:43 (85514): No heartbeat from client for 30 sec - exiting 13:47:44 (85514): timer handler: client dead, exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:01:15 (32643): No heartbeat from client for 30 sec - exiting 20:01:17 (32643): timer handler: client dead, exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 Sep 2014 11:53:09	1170047	16875331	hadcm3s_1aoa_1990_2_008918116_0	51,840	147,485	2.8450
13 Sep 2014 15:55:15	1170047	16875331	hadcm3s_1aoa_1990_2_008918116_0	25,920	78,356	3.0230