Task 13027855

Name	hadcm3n_t76k_1940_40_007316989_1
Workunit	7514419
Created	29 Jun 2011, 5:49:42 UTC
Sent	29 Jun 2011, 6:00:06 UTC
Report deadline	28 Sep 2011, 13:27:17 UTC
Received	16 Jul 2011, 6:00:14 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1120099
Run time	14 days 19 hours 27 min 20 sec
CPU time	11 days 15 hours 55 min 42 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	1.33 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.33</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 16:44:38 (492): No heartbeat from core client for 30 sec - exiting 16:44:39 (492): No heartbeat from core client for 30 sec - exiting 16:44:40 (492): No heartbeat from core client for 30 sec - exiting 16:44:41 (492): No heartbeat from core client for 30 sec - exiting 16:44:42 (492): No heartbeat from core client for 30 sec - exiting 16:44:43 (492): No heartbeat from core client for 30 sec - exiting 16:44:44 (492): No heartbeat from core client for 30 sec - exiting 16:44:46 (492): No heartbeat from core client for 30 sec - exiting 16:44:47 (492): No heartbeat from core client for 30 sec - exiting 16:44:48 (492): No heartbeat from core client for 30 sec - exiting 16:44:49 (492): No heartbeat from core client for 30 sec - exiting 16:44:50 (492): No heartbeat from core client for 30 sec - exiting 16:44:51 (492): No heartbeat from core client for 30 sec - exiting 16:44:52 (492): No heartbeat from core client for 30 sec - exiting 16:44:53 (492): No heartbeat from core client for 30 sec - exiting 16:44:54 (492): No heartbeat from core client for 30 sec - exiting 16:44:55 (492): No heartbeat from core client for 30 sec - exiting 16:44:56 (492): No heartbeat from core client for 30 sec - exiting 16:44:58 (492): No heartbeat from core client for 30 sec - exiting 16:44:59 (492): No heartbeat from core client for 30 sec - exiting 16:45:00 (492): No heartbeat from core client for 30 sec - exiting 16:45:01 (492): No heartbeat from core client for 30 sec - exiting 16:45:02 (492): No heartbeat from core client for 30 sec - exiting 16:45:03 (492): No heartbeat from core client for 30 sec - exiting 16:45:04 (492): No heartbeat from core client for 30 sec - exiting 16:45:05 (492): No heartbeat from core client for 30 sec - exiting 16:45:06 (492): No heartbeat from core client for 30 sec - exiting 16:45:07 (492): No heartbeat from core client for 30 sec - exiting 16:45:09 (492): No heartbeat from core client for 30 sec - exiting 16:45:10 (492): No heartbeat from core client for 30 sec - exiting 16:45:11 (492): No heartbeat from core client for 30 sec - exiting 16:45:12 (492): No heartbeat from core client for 30 sec - exiting 16:45:13 (492): No heartbeat from core client for 30 sec - exiting 16:45:14 (492): No heartbeat from core client for 30 sec - exiting 16:45:15 (492): No heartbeat from core client for 30 sec - exiting 16:45:16 (492): No heartbeat from core client for 30 sec - exiting 16:45:17 (492): No heartbeat from core client for 30 sec - exiting 16:45:18 (492): No heartbeat from core client for 30 sec - exiting 16:45:20 (492): No heartbeat from core client for 30 sec - exiting 16:45:21 (492): No heartbeat from core client for 30 sec - exiting 16:45:22 (492): No heartbeat from core client for 30 sec - exiting 16:45:23 (492): No heartbeat from core client for 30 sec - exiting 16:45:24 (492): No heartbeat from core client for 30 sec - exiting 16:45:25 (492): No heartbeat from core client for 30 sec - exiting 16:45:26 (492): No heartbeat from core client for 30 sec - exiting 16:45:27 (492): No heartbeat from core client for 30 sec - exiting 16:45:28 (492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/t76kko.pje1c10 Error converting file to netcdf: dataout/t76kko.pie1c10 Error converting file to netcdf: dataout/t76kko.pfe1c10 Error converting file to netcdf: dataout/t76kka.phe1c10 Error converting file to netcdf: dataout/t76kka.pge1c10 Error converting file to netcdf: dataout/t76kka.pee1c10 Error converting file to netcdf: dataout/t76kka.pde1c10 04:01:00 (1884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:01:02 (1884): No heartbeat from core client for 30 sec - exiting 04:01:03 (1884): No heartbeat from core client for 30 sec - exiting 04:01:05 (1884): No heartbeat from core client for 30 sec - exiting 04:01:06 (1884): No heartbeat from core client for 30 sec - exiting 04:01:07 (1884): No heartbeat from core client for 30 sec - exiting 04:01:08 (1884): No heartbeat from core client for 30 sec - exiting 17:41:02 (1324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:41:04 (1324): No heartbeat from core client for 30 sec - exiting 17:41:05 (1324): No heartbeat from core client for 30 sec - exiting 04:01:24 (3252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:01:26 (3252): No heartbeat from core client for 30 sec - exiting 04:01:27 (3252): No heartbeat from core client for 30 sec - exiting 04:01:28 (3252): No heartbeat from core client for 30 sec - exiting 21:31:17 (1544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:31:18 (1544): No heartbeat from core client for 30 sec - exiting 03:42:37 (1612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:42:38 (1612): No heartbeat from core client for 30 sec - exiting 03:42:39 (1612): No heartbeat from core client for 30 sec - exiting 06:26:01 (2184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:26:03 (2184): No heartbeat from core client for 30 sec - exiting 06:26:04 (2184): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:31:27 (2672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:31:29 (2672): No heartbeat from core client for 30 sec - exiting 12:31:30 (2672): No heartbeat from core client for 30 sec - exiting 12:35:26 (480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:35:28 (480): No heartbeat from core client for 30 sec - exiting 12:35:29 (480): No heartbeat from core client for 30 sec - exiting 12:35:30 (480): No heartbeat from core client for 30 sec - exiting 18:46:29 (2720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:46:31 (2720): No heartbeat from core client for 30 sec - exiting 21:26:40 (2444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:26:42 (2444): No heartbeat from core client for 30 sec - exiting 21:26:43 (2444): No heartbeat from core client for 30 sec - exiting 00:47:35 (3116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:47:37 (3116): No heartbeat from core client for 30 sec - exiting 00:47:39 (3116): No heartbeat from core client for 30 sec - exiting 03:27:21 (2992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:27:23 (2992): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 21:33:05 (408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:33:06 (408): No heartbeat from core client for 30 sec - exiting 21:33:08 (408): No heartbeat from core client for 30 sec - exiting 21:33:09 (408): No heartbeat from core client for 30 sec - exiting 06:39:20 (3544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:39:22 (3544): No heartbeat from core client for 30 sec - exiting 06:39:23 (3544): No heartbeat from core client for 30 sec - exiting 06:39:24 (3544): No heartbeat from core client for 30 sec - exiting 06:39:25 (3544): No heartbeat from core client for 30 sec - exiting 06:39:27 (3544): No heartbeat from core client for 30 sec - exiting 06:39:28 (3544): No heartbeat from core client for 30 sec - exiting 06:39:29 (3544): No heartbeat from core client for 30 sec - exiting 06:39:30 (3544): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:55:26 (3552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:55:28 (3552): No heartbeat from core client for 30 sec - exiting 15:55:29 (3552): No heartbeat from core client for 30 sec - exiting 15:55:30 (3552): No heartbeat from core client for 30 sec - exiting 15:55:32 (3552): No heartbeat from core client for 30 sec - exiting 15:55:33 (3552): No heartbeat from core client for 30 sec - exiting 15:55:34 (3552): No heartbeat from core client for 30 sec - exiting 15:55:35 (3552): No heartbeat from core client for 30 sec - exiting 15:55:36 (3552): No heartbeat from core client for 30 sec - exiting 15:55:37 (3552): No heartbeat from core client for 30 sec - exiting 15:55:38 (3552): No heartbeat from core client for 30 sec - exiting 15:55:39 (3552): No heartbeat from core client for 30 sec - exiting 15:55:40 (3552): No heartbeat from core client for 30 sec - exiting 15:55:41 (3552): No heartbeat from core client for 30 sec - exiting 21:42:50 (3056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:42:51 (3056): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:11:44 (2720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:54:09 (2488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:54:11 (2488): No heartbeat from core client for 30 sec - exiting 21:54:12 (2488): No heartbeat from core client for 30 sec - exiting 03:15:22 (560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:15:24 (560): No heartbeat from core client for 30 sec - exiting 03:15:25 (560): No heartbeat from core client for 30 sec - exiting 21:25:27 (628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:25:29 (628): No heartbeat from core client for 30 sec - exiting 21:25:30 (628): No heartbeat from core client for 30 sec - exiting 00:52:58 (3172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:52:59 (3172): No heartbeat from core client for 30 sec - exiting 00:53:00 (3172): No heartbeat from core client for 30 sec - exiting 06:05:59 (2124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:06:01 (2124): No heartbeat from core client for 30 sec - exiting 06:06:02 (2124): No heartbeat from core client for 30 sec - exiting 15:55:09 (3536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:55:11 (3536): No heartbeat from core client for 30 sec - exiting 15:55:12 (3536): No heartbeat from core client for 30 sec - exiting 09:21:37 (3632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:21:39 (3632): No heartbeat from core client for 30 sec - exiting 21:27:37 (2140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:27:39 (2140): No heartbeat from core client for 30 sec - exiting 21:27:40 (2140): No heartbeat from core client for 30 sec - exiting 21:27:41 (2140): No heartbeat from core client for 30 sec - exiting 21:27:42 (2140): No heartbeat from core client for 30 sec - exiting 00:09:21 (2072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:09:22 (2072): No heartbeat from core client for 30 sec - exiting 06:43:42 (3932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:43:44 (3932): No heartbeat from core client for 30 sec - exiting 06:43:45 (3932): No heartbeat from core client for 30 sec - exiting 09:18:44 (2376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:18:46 (2376): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 12:55:11 (504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:55:12 (504): No heartbeat from core client for 30 sec - exiting 12:55:14 (504): No heartbeat from core client for 30 sec - exiting 13:02:02 (2476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:44:03 (476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:44:04 (476): No heartbeat from core client for 30 sec - exiting 15:59:21 (3752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:59:22 (3752): No heartbeat from core client for 30 sec - exiting 01:00:08 (492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:00:10 (492): No heartbeat from core client for 30 sec - exiting 01:00:12 (492): No heartbeat from core client for 30 sec - exiting 01:00:13 (492): No heartbeat from core client for 30 sec - exiting 06:52:53 (3844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:52:55 (3844): No heartbeat from core client for 30 sec - exiting 06:52:56 (3844): No heartbeat from core client for 30 sec - exiting 06:52:57 (3844): No heartbeat from core client for 30 sec - exiting 06:52:58 (3844): No heartbeat from core client for 30 sec - exiting 06:52:59 (3844): No heartbeat from core client for 30 sec - exiting 06:53:00 (3844): No heartbeat from core client for 30 sec - exiting 06:53:01 (3844): No heartbeat from core client for 30 sec - exiting 06:53:02 (3844): No heartbeat from core client for 30 sec - exiting 06:53:04 (3844): No heartbeat from core client for 30 sec - exiting 06:53:05 (3844): No heartbeat from core client for 30 sec - exiting 06:53:06 (3844): No heartbeat from core client for 30 sec - exiting 06:53:07 (3844): No heartbeat from core client for 30 sec - exiting 17:33:19 (2140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:33:20 (2140): No heartbeat from core client for 30 sec - exiting 17:33:21 (2140): No heartbeat from core client for 30 sec - exiting 00:46:42 (936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:46:44 (936): No heartbeat from core client for 30 sec - exiting 00:46:45 (936): No heartbeat from core client for 30 sec - exiting 03:24:40 (3504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:24:42 (3504): No heartbeat from core client for 30 sec - exiting 03:24:43 (3504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:08:04 (2188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:08:05 (2188): No heartbeat from core client for 30 sec - exiting Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Jul 2011 15:02:57	1120099	13027855	hadcm3n_t76k_1940_40_007316989_1	259,200	1,007,710	3.8878
25 Jul 2011 15:02:57	1120099	13027855	hadcm3n_t76k_1940_40_007316989_1	233,280	913,787	3.9171
25 Jul 2011 15:02:57	1120099	13027855	hadcm3n_t76k_1940_40_007316989_1	207,360	804,108	3.8778
09 Jul 2011 06:04:26	1120099	13027855	hadcm3n_t76k_1940_40_007316989_1	181,440	693,388	3.8216
08 Jul 2011 06:02:40	1120099	13027855	hadcm3n_t76k_1940_40_007316989_1	155,520	597,537	3.8422
08 Jul 2011 06:02:40	1120099	13027855	hadcm3n_t76k_1940_40_007316989_1	129,600	502,212	3.8751
05 Jul 2011 06:02:46	1120099	13027855	hadcm3n_t76k_1940_40_007316989_1	103,680	401,369	3.8712
04 Jul 2011 06:01:38	1120099	13027855	hadcm3n_t76k_1940_40_007316989_1	77,760	308,430	3.9664
03 Jul 2011 06:18:08	1120099	13027855	hadcm3n_t76k_1940_40_007316989_1	51,840	217,375	4.1932
02 Jul 2011 06:04:07	1120099	13027855	hadcm3n_t76k_1940_40_007316989_1	25,920	117,849	4.5466