Task 16221961

Name	hadcm3n_7dsh_1980_40_008429156_1
Workunit	8580012
Created	14 Jan 2014, 1:38:02 UTC
Sent	14 Jan 2014, 1:39:59 UTC
Report deadline	15 Apr 2014, 9:07:10 UTC
Received	22 Jan 2014, 15:32:35 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1084069
Run time	6 days 11 hours 29 min 25 sec
CPU time	5 days 23 hours 39 min 21 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	3.06 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> (unknown error) - exit code 193 (0xc1) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 07:49:19 (9196): No heartbeat from core client for 30 sec - exiting 07:49:21 (9196): No heartbeat from core client for 30 sec - exiting 07:49:22 (9196): No heartbeat from core client for 30 sec - exiting 07:49:23 (9196): No heartbeat from core client for 30 sec - exiting 07:49:24 (9196): No heartbeat from core client for 30 sec - exiting 07:49:25 (9196): No heartbeat from core client for 30 sec - exiting 07:49:26 (9196): No heartbeat from core client for 30 sec - exiting 07:49:27 (9196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:34:22 (6324): No heartbeat from core client for 30 sec - exiting 23:34:23 (6324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 23:48:58 (2068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 00:11:39 (3796): No heartbeat from core client for 30 sec - exiting 00:11:40 (3796): No heartbeat from core client for 30 sec - exiting 00:11:41 (3796): No heartbeat from core client for 30 sec - exiting 00:11:42 (3796): No heartbeat from core client for 30 sec - exiting 00:11:43 (3796): No heartbeat from core client for 30 sec - exiting 00:11:44 (3796): No heartbeat from core client for 30 sec - exiting 00:11:45 (3796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 07:48:57 (8592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 18:57:32 (8472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 19:19:28 (4656): No heartbeat from core client for 30 sec - exiting 19:19:29 (4656): No heartbeat from core client for 30 sec - exiting 19:19:30 (4656): No heartbeat from core client for 30 sec - exiting 19:19:31 (4656): No heartbeat from core client for 30 sec - exiting 19:19:32 (4656): No heartbeat from core client for 30 sec - exiting 19:19:33 (4656): No heartbeat from core client for 30 sec - exiting 19:19:34 (4656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 21:03:38 (13124): No heartbeat from core client for 30 sec - exiting 21:03:39 (13124): No heartbeat from core client for 30 sec - exiting 21:03:40 (13124): No heartbeat from core client for 30 sec - exiting 21:03:41 (13124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 21:21:11 (12932): No heartbeat from core client for 30 sec - exiting 21:21:12 (12932): No heartbeat from core client for 30 sec - exiting 21:21:13 (12932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:21:14 (12932): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 00:13:51 (7700): No heartbeat from core client for 30 sec - exiting 00:13:52 (7700): No heartbeat from core client for 30 sec - exiting 00:13:53 (7700): No heartbeat from core client for 30 sec - exiting 00:13:54 (7700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 00:22:37 (6640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 01:30:17 (7208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 01:52:22 (8148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 07:54:49 (8544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:38:34 (4200): No heartbeat from core client for 30 sec - exiting 16:38:36 (4200): No heartbeat from core client for 30 sec - exiting 16:38:37 (4200): No heartbeat from core client for 30 sec - exiting 16:38:38 (4200): No heartbeat from core client for 30 sec - exiting 16:38:39 (4200): No heartbeat from core client for 30 sec - exiting 16:38:40 (4200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:51:30 (9948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:17:48 (12212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 18:05:51 (11740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 21:02:38 (7980): No heartbeat from core client for 30 sec - exiting 21:02:39 (7980): No heartbeat from core client for 30 sec - exiting 21:02:40 (7980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 00:36:26 (8632): No heartbeat from core client for 30 sec - exiting 00:36:27 (8632): No heartbeat from core client for 30 sec - exiting 00:36:28 (8632): No heartbeat from core client for 30 sec - exiting 00:36:29 (8632): No heartbeat from core client for 30 sec - exiting 00:36:30 (8632): No heartbeat from core client for 30 sec - exiting 00:36:31 (8632): No heartbeat from core client for 30 sec - exiting 00:36:32 (8632): No heartbeat from core client for 30 sec - exiting 00:36:33 (8632): No heartbeat from core client for 30 sec - exiting 00:36:34 (8632): No heartbeat from core client for 30 sec - exiting 00:36:35 (8632): No heartbeat from core client for 30 sec - exiting 00:36:36 (8632): No heartbeat from core client for 30 sec - exiting 00:36:37 (8632): No heartbeat from core client for 30 sec - exiting 00:36:38 (8632): No heartbeat from core client for 30 sec - exiting 00:36:39 (8632): No heartbeat from core client for 30 sec - exiting 00:36:40 (8632): No heartbeat from core client for 30 sec - exiting 00:36:41 (8632): No heartbeat from core client for 30 sec - exiting 00:36:42 (8632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/7dshko.pji5c10 Error converting file to netcdf: dataout/7dshko.pii5c10 Error converting file to netcdf: dataout/7dshko.pfi5c10 Error converting file to netcdf: dataout/7dshka.phi5c10 Error converting file to netcdf: dataout/7dshka.pgi5c10 Error converting file to netcdf: dataout/7dshka.pei5c10 Error converting file to netcdf: dataout/7dshka.pdi5c10 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 11:41:53 (13568): No heartbeat from core client for 30 sec - exiting 11:41:54 (13568): No heartbeat from core client for 30 sec - exiting 11:41:55 (13568): No heartbeat from core client for 30 sec - exiting 11:41:56 (13568): No heartbeat from core client for 30 sec - exiting 11:41:57 (13568): No heartbeat from core client for 30 sec - exiting 11:41:58 (13568): No heartbeat from core client for 30 sec - exiting 11:41:59 (13568): No heartbeat from core client for 30 sec - exiting 11:42:00 (13568): No heartbeat from core client for 30 sec - exiting 11:42:01 (13568): No heartbeat from core client for 30 sec - exiting 11:42:02 (13568): No heartbeat from core client for 30 sec - exiting 11:42:03 (13568): No heartbeat from core client for 30 sec - exiting 11:42:04 (13568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 00:23:37 (14616): No heartbeat from core client for 30 sec - exiting 00:23:38 (14616): No heartbeat from core client for 30 sec - exiting 00:23:39 (14616): No heartbeat from core client for 30 sec - exiting 00:23:40 (14616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:29:25 (14192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:30:25 (8488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:31:34 (6208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
22 Jan 2014 15:39:22	1084069	16221961	hadcm3n_7dsh_1980_40_008429156_1	259,200	517,157	1.9952
21 Jan 2014 19:35:36	1084069	16221961	hadcm3n_7dsh_1980_40_008429156_1	233,280	465,539	1.9956
21 Jan 2014 03:38:55	1084069	16221961	hadcm3n_7dsh_1980_40_008429156_1	207,360	413,127	1.9923
20 Jan 2014 07:35:05	1084069	16221961	hadcm3n_7dsh_1980_40_008429156_1	181,440	362,938	2.0003
19 Jan 2014 05:34:26	1084069	16221961	hadcm3n_7dsh_1980_40_008429156_1	155,520	312,487	2.0093
18 Jan 2014 01:35:26	1084069	16221961	hadcm3n_7dsh_1980_40_008429156_1	129,600	262,393	2.0246
17 Jan 2014 05:06:17	1084069	16221961	hadcm3n_7dsh_1980_40_008429156_1	103,680	209,400	2.0197
16 Jan 2014 08:18:23	1084069	16221961	hadcm3n_7dsh_1980_40_008429156_1	77,760	157,636	2.0272
15 Jan 2014 12:34:58	1084069	16221961	hadcm3n_7dsh_1980_40_008429156_1	51,840	105,255	2.0304
14 Jan 2014 18:10:02	1084069	16221961	hadcm3n_7dsh_1980_40_008429156_1	25,920	52,025	2.0071