Task 17264941

Name	hadcm3s_42vg_1983_2_009122140_0
Workunit	9252476
Created	22 Oct 2014, 18:11:33 UTC
Sent	31 Oct 2014, 5:59:28 UTC
Report deadline	30 Jan 2015, 13:26:39 UTC
Received	7 Nov 2014, 17:26:11 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1266912
Run time	1 days 20 hours 47 min 15 sec
CPU time	1 days 20 hours 41 min 46 sec
Validate state	Invalid
Credit	622.08
Device peak FLOPS	1.27 GFLOPS
Application version	UK Met Office HadCM3 short v7.24 i686-pc-linux-gnu
Stderr	<core_client_version>6.12.43</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> MonID=21539, UMPID=21554, RM3PID=0 23:54:47 (21539): No heartbeat from client for 30 sec - exiting 23:54:48 (21539): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=21596, UMPID=21602, RM3PID=0 00:00:13 (21596): No heartbeat from client for 30 sec - exiting 00:00:13 (21596): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:00:14 (21596): No heartbeat from client for 30 sec - exiting 00:00:14 (21596): timer handler: client dead, exiting MonID=21661, UMPID=21663, RM3PID=0 00:09:18 (21661): No heartbeat from client for 30 sec - exiting 00:09:18 (21661): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:09:19 (21661): No heartbeat from client for 30 sec - exiting 00:09:19 (21661): timer handler: client dead, exiting 00:09:20 (21661): No heartbeat from client for 30 sec - exiting 00:09:20 (21661): timer handler: client dead, exiting MonID=21767, UMPID=21769, RM3PID=0 CPDN Monitor - Quit request from BOINC... MonID=29674, UMPID=29676, RM3PID=0 12:23:16 (29674): No heartbeat from client for 30 sec - exiting 12:23:24 (29674): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=29730, UMPID=29734, RM3PID=0 CPDN Monitor - Quit request from BOINC... MonID=32413, UMPID=32415, RM3PID=0 16:58:53 (32413): No heartbeat from client for 30 sec - exiting 16:58:53 (32413): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:58:54 (32413): No heartbeat from client for 30 sec - exiting 16:58:54 (32413): timer handler: client dead, exiting MonID=559, UMPID=561, RM3PID=0 CPDN Monitor - Quit request from BOINC... MonID=3936, UMPID=3938, RM3PID=0 CPDN Monitor - Quit request from BOINC... MonID=6799, UMPID=6801, RM3PID=0 03:10:20 (6799): No heartbeat from client for 30 sec - exiting 03:10:26 (6799): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:10:27 (6799): No heartbeat from client for 30 sec - exiting 03:10:27 (6799): timer handler: client dead, exiting 03:10:28 (6799): No heartbeat from client for 30 sec - exiting 03:10:28 (6799): timer handler: client dead, exiting MonID=6850, UMPID=6852, RM3PID=0 03:23:41 (6850): No heartbeat from client for 30 sec - exiting 03:23:41 (6850): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:23:42 (6850): No heartbeat from client for 30 sec - exiting 03:23:42 (6850): timer handler: client dead, exiting 03:23:43 (6850): No heartbeat from client for 30 sec - exiting 03:23:43 (6850): timer handler: client dead, exiting 03:23:44 (6850): No heartbeat from client for 30 sec - exiting 03:23:44 (6850): timer handler: client dead, exiting 03:23:45 (6850): No heartbeat from client for 30 sec - exiting 03:23:45 (6850): timer handler: client dead, exiting 03:23:46 (6850): No heartbeat from client for 30 sec - exiting 03:23:46 (6850): timer handler: client dead, exiting 03:23:47 (6850): No heartbeat from client for 30 sec - exiting 03:23:47 (6850): timer handler: client dead, exiting MonID=6976, UMPID=6978, RM3PID=0 CPDN Monitor - Quit request from BOINC... MonID=7804, UMPID=7806, RM3PID=0 CPDN Monitor - Quit request from BOINC... MonID=9677, UMPID=9679, RM3PID=0 08:02:36 (9677): No heartbeat from client for 30 sec - exiting 08:02:36 (9677): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=9765, UMPID=9767, RM3PID=0 CPDN Monitor - Quit request from BOINC... MonID=12160, UMPID=12162, RM3PID=0 CPDN Monitor - Quit request from BOINC... MonID=19750, UMPID=19752, RM3PID=0 23:25:43 (19750): No heartbeat from client for 30 sec - exiting 23:25:46 (19750): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=19771, UMPID=19773, RM3PID=0 01:25:07 (19771): No heartbeat from client for 30 sec - exiting 01:25:07 (19771): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:25:08 (19771): No heartbeat from client for 30 sec - exiting 01:25:08 (19771): timer handler: client dead, exiting 01:25:09 (19771): No heartbeat from client for 30 sec - exiting 01:25:09 (19771): timer handler: client dead, exiting 01:25:10 (19771): No heartbeat from client for 30 sec - exiting 01:25:10 (19771): timer handler: client dead, exiting MonID=20947, UMPID=20949, RM3PID=0 01:40:10 (20947): No heartbeat from client for 30 sec - exiting 01:40:10 (20947): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:40:11 (20947): No heartbeat from client for 30 sec - exiting 01:40:11 (20947): timer handler: client dead, exiting 01:40:12 (20947): No heartbeat from client for 30 sec - exiting 01:40:12 (20947): timer handler: client dead, exiting 01:40:13 (20947): No heartbeat from client for 30 sec - exiting 01:40:13 (20947): timer handler: client dead, exiting 01:40:14 (20947): No heartbeat from client for 30 sec - exiting 01:40:14 (20947): timer handler: client dead, exiting 01:40:15 (20947): No heartbeat from client for 30 sec - exiting 01:40:15 (20947): timer handler: client dead, exiting 01:40:16 (20947): No heartbeat from client for 30 sec - exiting 01:40:16 (20947): timer handler: client dead, exiting 01:40:17 (20947): No heartbeat from client for 30 sec - exiting 01:40:17 (20947): timer handler: client dead, exiting MonID=21115, UMPID=21117, RM3PID=0 01:58:09 (21115): No heartbeat from client for 30 sec - exiting 01:58:10 (21115): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=21295, UMPID=21297, RM3PID=0 CPDN Monitor - Quit request from BOINC... MonID=21960, UMPID=21962, RM3PID=0 03:06:35 (21960): No heartbeat from client for 30 sec - exiting 03:06:35 (21960): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:06:36 (21960): No heartbeat from client for 30 sec - exiting 03:06:36 (21960): timer handler: client dead, exiting 03:06:37 (21960): No heartbeat from client for 30 sec - exiting 03:06:37 (21960): timer handler: client dead, exiting 03:06:38 (21960): No heartbeat from client for 30 sec - exiting 03:06:38 (21960): timer handler: client dead, exiting 03:06:39 (21960): No heartbeat from client for 30 sec - exiting 03:06:39 (21960): timer handler: client dead, exiting 03:06:40 (21960): No heartbeat from client for 30 sec - exiting 03:06:40 (21960): timer handler: client dead, exiting 03:06:41 (21960): No heartbeat from client for 30 sec - exiting 03:06:41 (21960): timer handler: client dead, exiting 03:06:42 (21960): No heartbeat from client for 30 sec - exiting 03:06:42 (21960): timer handler: client dead, exiting 03:06:43 (21960): No heartbeat from client for 30 sec - exiting 03:06:43 (21960): timer handler: client dead, exiting 03:06:44 (21960): No heartbeat from client for 30 sec - exiting 03:06:44 (21960): timer handler: client dead, exiting 03:06:45 (21960): No heartbeat from client for 30 sec - exiting 03:06:45 (21960): timer handler: client dead, exiting 03:06:46 (21960): No heartbeat from client for 30 sec - exiting 03:06:46 (21960): timer handler: client dead, exiting 03:06:47 (21960): No heartbeat from client for 30 sec - exiting 03:06:47 (21960): timer handler: client dead, exiting 03:06:48 (21960): No heartbeat from client for 30 sec - exiting 03:06:48 (21960): timer handler: client dead, exiting 03:06:49 (21960): No heartbeat from client for 30 sec - exiting 03:06:49 (21960): timer handler: client dead, exiting 03:06:50 (21960): No heartbeat from client for 30 sec - exiting 03:06:50 (21960): timer handler: client dead, exiting 03:06:51 (21960): No heartbeat from client for 30 sec - exiting 03:06:51 (21960): timer handler: client dead, exiting 03:06:52 (21960): No heartbeat from client for 30 sec - exiting 03:06:52 (21960): timer handler: client dead, exiting 03:06:53 (21960): No heartbeat from client for 30 sec - exiting 03:06:53 (21960): timer handler: client dead, exiting 03:06:54 (21960): No heartbeat from client for 30 sec - exiting 03:06:54 (21960): timer handler: client dead, exiting 03:06:55 (21960): No heartbeat from client for 30 sec - exiting 03:06:55 (21960): timer handler: client dead, exiting 03:06:56 (21960): No heartbeat from client for 30 sec - exiting 03:06:56 (21960): timer handler: client dead, exiting 03:06:57 (21960): No heartbeat from client for 30 sec - exiting 03:06:57 (21960): timer handler: client dead, exiting MonID=22010, UMPID=22012, RM3PID=0 CPDN Monitor - Quit request from BOINC... MonID=22353, UMPID=22355, RM3PID=0 03:44:58 (22353): No heartbeat from client for 30 sec - exiting 03:45:04 (22353): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=22403, UMPID=22405, RM3PID=0 04:02:02 (22403): No heartbeat from client for 30 sec - exiting 04:02:02 (22403): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=22602, UMPID=22604, RM3PID=0 04:11:15 (22602): No heartbeat from client for 30 sec - exiting 04:11:15 (22602): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:11:47 (22695): No heartbeat from client for 30 sec - exiting 04:11:53 (22695): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=22715, UMPID=22717, RM3PID=0 04:33:27 (22715): No heartbeat from client for 30 sec - exiting 04:33:44 (22715): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=22932, UMPID=22934, RM3PID=0 CPDN Monitor - Quit request from BOINC... MonID=23529, UMPID=23531, RM3PID=0 05:35:34 (23529): No heartbeat from client for 30 sec - exiting 05:35:34 (23529): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:35:35 (23529): No heartbeat from client for 30 sec - exiting 05:35:35 (23529): timer handler: client dead, exiting 05:35:36 (23529): No heartbeat from client for 30 sec - exiting 05:35:37 (23529): timer handler: client dead, exiting MonID=23608, UMPID=23610, RM3PID=0 06:00:18 (23608): No heartbeat from client for 30 sec - exiting 06:00:26 (23608): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=23869, UMPID=23871, RM3PID=0 06:06:14 (23869): No heartbeat from client for 30 sec - exiting 06:06:14 (23869): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=23963, UMPID=23965, RM3PID=0 06:28:55 (23963): No heartbeat from client for 30 sec - exiting 06:28:55 (23963): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=24185, UMPID=24187, RM3PID=0 06:40:54 (24185): No heartbeat from client for 30 sec - exiting 06:40:54 (24185): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:40:55 (24185): No heartbeat from client for 30 sec - exiting 06:40:55 (24185): timer handler: client dead, exiting 06:40:56 (24185): No heartbeat from client for 30 sec - exiting 06:40:56 (24185): timer handler: client dead, exiting 06:40:57 (24185): No heartbeat from client for 30 sec - exiting 06:40:57 (24185): timer handler: client dead, exiting 06:40:58 (24185): No heartbeat from client for 30 sec - exiting 06:41:17 (24185): timer handler: client dead, exiting MonID=24315, UMPID=24317, RM3PID=0 07:29:35 (24315): No heartbeat from client for 30 sec - exiting 07:29:35 (24315): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:29:36 (24315): No heartbeat from client for 30 sec - exiting 07:29:36 (24315): timer handler: client dead, exiting 07:29:37 (24315): No heartbeat from client for 30 sec - exiting 07:29:37 (24315): timer handler: client dead, exiting 07:29:38 (24315): No heartbeat from client for 30 sec - exiting 07:29:38 (24315): timer handler: client dead, exiting 07:29:39 (24315): No heartbeat from client for 30 sec - exiting 07:29:39 (24315): timer handler: client dead, exiting 07:29:40 (24315): No heartbeat from client for 30 sec - exiting 07:29:40 (24315): timer handler: client dead, exiting 07:29:41 (24315): No heartbeat from client for 30 sec - exiting 07:29:41 (24315): timer handler: client dead, exiting 07:29:42 (24315): No heartbeat from client for 30 sec - exiting 07:29:42 (24315): timer handler: client dead, exiting 07:29:43 (24315): No heartbeat from client for 30 sec - exiting 07:29:43 (24315): timer handler: client dead, exiting 07:29:44 (24315): No heartbeat from client for 30 sec - exiting 07:29:44 (24315): timer handler: client dead, exiting 07:29:45 (24315): No heartbeat from client for 30 sec - exiting 07:29:45 (24315): timer handler: client dead, exiting MonID=24818, UMPID=24820, RM3PID=0 07:53:28 (24818): No heartbeat from client for 30 sec - exiting 07:53:32 (24818): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=25060, UMPID=25062, RM3PID=0 mv: cannot stat 'dataout/atmos_restart.hold': No such file or directory mv: cannot stat 'dataout/atmos_restart.hold': No such file or directory mv: cannot stat 'dataout/atmos_restart.hold': No such file or directory mv: cannot stat 'dataout/atmos_restart.hold': No such file or directory mv: cannot stat 'dataout/atmos_restart.hold': No such file or directory Atmos Hold Restart file rename failed on atmos_restart.hold 08:42:23 (25060): No heartbeat from client for 30 sec - exiting 08:42:30 (25060): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:42:31 (25060): No heartbeat from client for 30 sec - exiting 08:42:31 (25060): timer handler: client dead, exiting 08:42:32 (25060): No heartbeat from client for 30 sec - exiting 08:42:32 (25060): timer handler: client dead, exiting 08:42:33 (25060): No heartbeat from client for 30 sec - exiting 08:42:33 (25060): timer handler: client dead, exiting 08:42:34 (25060): No heartbeat from client for 30 sec - exiting 08:42:34 (25060): timer handler: client dead, exiting 08:42:35 (25060): No heartbeat from client for 30 sec - exiting 08:42:35 (25060): timer handler: client dead, exiting 08:42:36 (25060): No heartbeat from client for 30 sec - exiting 08:42:36 (25060): timer handler: client dead, exiting 08:42:37 (25060): No heartbeat from client for 30 sec - exiting 08:42:37 (25060): timer handler: client dead, exiting 08:42:38 (25060): No heartbeat from client for 30 sec - exiting 08:42:38 (25060): timer handler: client dead, exiting 08:42:39 (25060): No heartbeat from client for 30 sec - exiting 08:42:39 (25060): timer handler: client dead, exiting 08:42:40 (25060): No heartbeat from client for 30 sec - exiting 08:42:40 (25060): timer handler: client dead, exiting 08:42:41 (25060): No heartbeat from client for 30 sec - exiting 08:42:41 (25060): timer handler: client dead, exiting 08:42:42 (25060): No heartbeat from client for 30 sec - exiting 08:42:42 (25060): timer handler: client dead, exiting MonID=25566, UMPID=25570, RM3PID=0 08:51:26 (25566): No heartbeat from client for 30 sec - exiting 08:51:26 (25566): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:51:27 (25566): No heartbeat from client for 30 sec - exiting 08:51:27 (25566): timer handler: client dead, exiting 08:51:28 (25566): No heartbeat from client for 30 sec - exiting 08:51:28 (25566): timer handler: client dead, exiting 08:51:29 (25566): No heartbeat from client for 30 sec - exiting 08:51:29 (25566): timer handler: client dead, exiting 08:51:30 (25566): No heartbeat from client for 30 sec - exiting 08:51:30 (25566): timer handler: client dead, exiting 08:51:31 (25566): No heartbeat from client for 30 sec - exiting 08:51:31 (25566): timer handler: client dead, exiting 08:51:32 (25566): No heartbeat from client for 30 sec - exiting 08:51:32 (25566): timer handler: client dead, exiting 08:51:33 (25566): No heartbeat from client for 30 sec - exiting 08:51:33 (25566): timer handler: client dead, exiting 08:51:34 (25566): No heartbeat from client for 30 sec - exiting 08:51:34 (25566): timer handler: client dead, exiting 08:51:36 (25566): No heartbeat from client for 30 sec - exiting 08:51:36 (25566): timer handler: client dead, exiting 08:51:37 (25566): No heartbeat from client for 30 sec - exiting 08:51:37 (25566): timer handler: client dead, exiting 08:51:38 (25566): No heartbeat from client for 30 sec - exiting 08:51:38 (25566): timer handler: client dead, exiting 08:51:39 (25566): No heartbeat from client for 30 sec - exiting 08:51:39 (25566): timer handler: client dead, exiting 08:51:40 (25566): No heartbeat from client for 30 sec - exiting 08:51:40 (25566): timer handler: client dead, exiting 08:51:41 (25566): No heartbeat from client for 30 sec - exiting 08:51:41 (25566): timer handler: client dead, exiting 08:51:42 (25566): No heartbeat from client for 30 sec - exiting 08:51:42 (25566): timer handler: client dead, exiting 08:51:43 (25566): No heartbeat from client for 30 sec - exiting 08:51:43 (25566): timer handler: client dead, exiting 08:51:44 (25566): No heartbeat from client for 30 sec - exiting 08:51:44 (25566): timer handler: client dead, exiting 08:51:45 (25566): No heartbeat from client for 30 sec - exiting 08:51:45 (25566): timer handler: client dead, exiting 08:51:46 (25566): No heartbeat from client for 30 sec - exiting 08:51:46 (25566): timer handler: client dead, exiting 08:51:47 (25566): No heartbeat from client for 30 sec - exiting 08:51:47 (25566): timer handler: client dead, exiting 08:51:48 (25566): No heartbeat from client for 30 sec - exiting 08:51:48 (25566): timer handler: client dead, exiting 08:51:49 (25566): No heartbeat from client for 30 sec - exiting 08:51:49 (25566): timer handler: client dead, exiting 08:51:50 (25566): No heartbeat from client for 30 sec - exiting 08:51:50 (25566): timer handler: client dead, exiting 08:51:51 (25566): No heartbeat from client for 30 sec - exiting 08:51:51 (25566): timer handler: client dead, exiting 08:51:52 (25566): No heartbeat from client for 30 sec - exiting 08:51:52 (25566): timer handler: client dead, exiting 08:51:53 (25566): No heartbeat from client for 30 sec - exiting 08:51:53 (25566): timer handler: client dead, exiting 08:51:54 (25566): No heartbeat from client for 30 sec - exiting 08:51:54 (25566): timer handler: client dead, exiting 08:51:55 (25566): No heartbeat from client for 30 sec - exiting 08:51:55 (25566): timer handler: client dead, exiting 08:51:56 (25566): No heartbeat from client for 30 sec - exiting 08:51:56 (25566): timer handler: client dead, exiting MonID=25702, UMPID=25705, RM3PID=0 08:55:20 (25702): No heartbeat from client for 30 sec - exiting 08:55:20 (25702): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:55:21 (25702): No heartbeat from client for 30 sec - exiting 08:55:21 (25702): timer handler: client dead, exiting 08:55:22 (25702): No heartbeat from client for 30 sec - exiting 08:55:22 (25702): timer handler: client dead, exiting 08:55:23 (25702): No heartbeat from client for 30 sec - exiting 08:55:23 (25702): timer handler: client dead, exiting 08:55:24 (25702): No heartbeat from client for 30 sec - exiting 08:55:24 (25702): timer handler: client dead, exiting 08:55:25 (25702): No heartbeat from client for 30 sec - exiting 08:55:25 (25702): timer handler: client dead, exiting 08:55:26 (25702): No heartbeat from client for 30 sec - exiting 08:55:26 (25702): timer handler: client dead, exiting 08:55:27 (25702): No heartbeat from client for 30 sec - exiting 08:55:27 (25702): timer handler: client dead, exiting 08:55:28 (25702): No heartbeat from client for 30 sec - exiting 08:55:28 (25702): timer handler: client dead, exiting 08:55:29 (25702): No heartbeat from client for 30 sec - exiting 08:55:29 (25702): timer handler: client dead, exiting 08:55:30 (25702): No heartbeat from client for 30 sec - exiting 08:55:30 (25702): timer handler: client dead, exiting 08:55:31 (25702): No heartbeat from client for 30 sec - exiting 08:55:31 (25702): timer handler: client dead, exiting 08:55:32 (25702): No heartbeat from client for 30 sec - exiting 08:55:32 (25702): timer handler: client dead, exiting 08:55:33 (25702): No heartbeat from client for 30 sec - exiting 08:55:33 (25702): timer handler: client dead, exiting 08:55:34 (25702): No heartbeat from client for 30 sec - exiting 08:55:34 (25702): timer handler: client dead, exiting 08:55:35 (25702): No heartbeat from client for 30 sec - exiting 08:55:35 (25702): timer handler: client dead, exiting 08:55:36 (25702): No heartbeat from client for 30 sec - exiting 08:55:36 (25702): timer handler: client dead, exiting MonID=25737, UMPID=25739, RM3PID=0 08:59:17 (25737): No heartbeat from client for 30 sec - exiting 08:59:17 (25737): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=25785, UMPID=25787, RM3PID=0 09:02:34 (25785): No heartbeat from client for 30 sec - exiting 09:02:57 (25785): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=25852, UMPID=25854, RM3PID=0 09:07:45 (25852): No heartbeat from client for 30 sec - exiting 09:07:47 (25852): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=25908, UMPID=25913, RM3PID=0 09:20:42 (25908): No heartbeat from client for 30 sec - exiting 09:20:52 (25908): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=26046, UMPID=26048, RM3PID=0 09:29:00 (26046): No heartbeat from client for 30 sec - exiting 09:29:18 (26046): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:29:19 (26046): No heartbeat from client for 30 sec - exiting 09:29:19 (26046): timer handler: client dead, exiting 09:29:20 (26046): No heartbeat from client for 30 sec - exiting 09:29:20 (26046): timer handler: client dead, exiting MonID=26140, UMPID=26142, RM3PID=0 09:32:51 (26140): No heartbeat from client for 30 sec - exiting 09:33:02 (26140): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:33:03 (26140): No heartbeat from client for 30 sec - exiting 09:33:03 (26140): timer handler: client dead, exiting 09:33:04 (26140): No heartbeat from client for 30 sec - exiting 09:33:04 (26140): timer handler: client dead, exiting MonID=26192, UMPID=26198, RM3PID=0 09:42:25 (26192): No heartbeat from client for 30 sec - exiting 09:42:25 (26192): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:42:26 (26192): No heartbeat from client for 30 sec - exiting 09:42:26 (26192): timer handler: client dead, exiting 09:42:27 (26192): No heartbeat from client for 30 sec - exiting 09:42:27 (26192): timer handler: client dead, exiting MonID=26287, UMPID=26290, RM3PID=0 09:46:12 (26287): No heartbeat from client for 30 sec - exiting 09:46:12 (26287): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:46:13 (26287): No heartbeat from client for 30 sec - exiting 09:46:13 (26287): timer handler: client dead, exiting 09:46:14 (26287): No heartbeat from client for 30 sec - exiting 09:46:14 (26287): timer handler: client dead, exiting 09:46:15 (26287): No heartbeat from client for 30 sec - exiting 09:46:15 (26287): timer handler: client dead, exiting 09:46:16 (26287): No heartbeat from client for 30 sec - exiting 09:46:16 (26287): timer handler: client dead, exiting 09:46:17 (26287): No heartbeat from client for 30 sec - exiting 09:46:17 (26287): timer handler: client dead, exiting 09:46:18 (26287): No heartbeat from client for 30 sec - exiting 09:46:18 (26287): timer handler: client dead, exiting 09:46:19 (26287): No heartbeat from client for 30 sec - exiting 09:46:19 (26287): timer handler: client dead, exiting 09:46:20 (26287): No heartbeat from client for 30 sec - exiting 09:46:20 (26287): timer handler: client dead, exiting 09:46:21 (26287): No heartbeat from client for 30 sec - exiting 09:46:21 (26287): timer handler: client dead, exiting 09:46:22 (26287): No heartbeat from client for 30 sec - exiting 09:46:22 (26287): timer handler: client dead, exiting 09:46:23 (26287): No heartbeat from client for 30 sec - exiting 09:46:23 (26287): timer handler: client dead, exiting 09:46:24 (26287): No heartbeat from client for 30 sec - exiting 09:46:24 (26287): timer handler: client dead, exiting 09:46:25 (26287): No heartbeat from client for 30 sec - exiting 09:46:25 (26287): timer handler: client dead, exiting 09:46:26 (26287): No heartbeat from client for 30 sec - exiting 09:46:26 (26287): timer handler: client dead, exiting 09:46:27 (26287): No heartbeat from client for 30 sec - exiting 09:46:27 (26287): timer handler: client dead, exiting 09:46:28 (26287): No heartbeat from client for 30 sec - exiting 09:46:28 (26287): timer handler: client dead, exiting 09:46:29 (26287): No heartbeat from client for 30 sec - exiting 09:46:29 (26287): timer handler: client dead, exiting 09:46:30 (26287): No heartbeat from client for 30 sec - exiting 09:46:30 (26287): timer handler: client dead, exiting 09:46:31 (26287): No heartbeat from client for 30 sec - exiting 09:46:31 (26287): timer handler: client dead, exiting 09:46:32 (26287): No heartbeat from client for 30 sec - exiting 09:46:32 (26287): timer handler: client dead, exiting 09:46:33 (26287): No heartbeat from client for 30 sec - exiting 09:46:33 (26287): timer handler: client dead, exiting 09:46:34 (26287): No heartbeat from client for 30 sec - exiting 09:46:34 (26287): timer handler: client dead, exiting 09:46:35 (26287): No heartbeat from client for 30 sec - exiting 09:46:35 (26287): timer handler: client dead, exiting 09:46:36 (26287): No heartbeat from client for 30 sec - exiting 09:46:36 (26287): timer handler: client dead, exiting 09:46:37 (26287): No heartbeat from client for 30 sec - exiting 09:46:37 (26287): timer handler: client dead, exiting 09:46:38 (26287): No heartbeat from client for 30 sec - exiting 09:46:38 (26287): timer handler: client dead, exiting MonID=26350, UMPID=26352, RM3PID=0 09:49:49 (26350): No heartbeat from client for 30 sec - exiting 09:49:49 (26350): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=26427, UMPID=26429, RM3PID=0 09:59:55 (26427): No heartbeat from client for 30 sec - exiting 09:59:56 (26427): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:59:57 (26427): No heartbeat from client for 30 sec - exiting 09:59:57 (26427): timer handler: client dead, exiting 09:59:58 (26427): No heartbeat from client for 30 sec - exiting 09:59:58 (26427): timer handler: client dead, exiting 09:59:59 (26427): No heartbeat from client for 30 sec - exiting 09:59:59 (26427): timer handler: client dead, exiting 10:00:00 (26427): No heartbeat from client for 30 sec - exiting 10:00:00 (26427): timer handler: client dead, exiting 10:00:01 (26427): No heartbeat from client for 30 sec - exiting 10:00:01 (26427): timer handler: client dead, exiting 10:00:02 (26427): No heartbeat from client for 30 sec - exiting 10:00:02 (26427): timer handler: client dead, exiting 10:00:03 (26427): No heartbeat from client for 30 sec - exiting 10:00:03 (26427): timer handler: client dead, exiting 10:00:04 (26427): No heartbeat from client for 30 sec - exiting 10:00:04 (26427): timer handler: client dead, exiting 10:00:05 (26427): No heartbeat from client for 30 sec - exiting 10:00:05 (26427): timer handler: client dead, exiting 10:00:06 (26427): No heartbeat from client for 30 sec - exiting 10:00:06 (26427): timer handler: client dead, exiting 10:00:07 (26427): No heartbeat from client for 30 sec - exiting 10:00:07 (26427): timer handler: client dead, exiting 10:00:08 (26427): No heartbeat from client for 30 sec - exiting 10:00:08 (26427): timer handler: client dead, exiting MonID=26753, UMPID=26755, RM3PID=0 CPDN Monitor - Quit request from BOINC... MonID=28009, UMPID=28011, RM3PID=0 CPDN Monitor - Quit request from BOINC... MonID=2762, UMPID=2764, RM3PID=0 21:53:45 (2762): No heartbeat from client for 30 sec - exiting 21:53:48 (2762): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=3184, UMPID=3186, RM3PID=0 21:57:10 (3184): No heartbeat from client for 30 sec - exiting 21:57:10 (3184): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=3222, UMPID=3224, RM3PID=0 23:23:43 (3222): No heartbeat from client for 30 sec - exiting 23:23:44 (3222): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=4094, UMPID=4096, RM3PID=0 CPDN Monitor - Quit request from BOINC... MonID=5591, UMPID=5593, RM3PID=0 02:14:01 (5591): No heartbeat from client for 30 sec - exiting 02:14:02 (5591): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=5819, UMPID=5821, RM3PID=0 CPDN Monitor - Quit request from BOINC... MonID=6160, UMPID=6162, RM3PID=0 CPDN Monitor - Quit request from BOINC... MonID=13351, UMPID=13353, RM3PID=0 19:52:08 (13351): No heartbeat from client for 30 sec - exiting 19:52:08 (13351): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=17849, UMPID=17853, RM3PID=0 CPDN Monitor - Quit request from BOINC... MonID=18256, UMPID=18259, RM3PID=0 CPDN Monitor - Quit request from BOINC... MonID=20334, UMPID=20336, RM3PID=0 CPDN Monitor - Quit request from BOINC... MonID=20637, UMPID=20639, RM3PID=0 CPDN Monitor - Quit request from BOINC... MonID=20910, UMPID=20912, RM3PID=0 CPDN Monitor - Quit request from BOINC... MonID=21219, UMPID=21221, RM3PID=0 CPDN Monitor - Quit request from BOINC... MonID=21490, UMPID=21492, RM3PID=0 CPDN Monitor - Quit request from BOINC... MonID=21850, UMPID=21852, RM3PID=0 02:33:34 (21850): No heartbeat from client for 30 sec - exiting 02:33:35 (21850): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=21934, UMPID=21936, RM3PID=0 CPDN Monitor - Quit request from BOINC... MonID=22418, UMPID=22420, RM3PID=0 CPDN Monitor - Quit request from BOINC... MonID=22625, UMPID=22627, RM3PID=0 CPDN Monitor - Quit request from BOINC... MonID=23055, UMPID=23057, RM3PID=0 CPDN Monitor - Quit request from BOINC... MonID=23411, UMPID=23413, RM3PID=0 CPDN Monitor - Quit request from BOINC... MonID=23724, UMPID=23726, RM3PID=0 CPDN Monitor - Quit request from BOINC... MonID=24159, UMPID=24161, RM3PID=0 CPDN Monitor - Quit request from BOINC... MonID=24390, UMPID=24392, RM3PID=0 CPDN Monitor - Quit request from BOINC... MonID=24765, UMPID=24767, RM3PID=0 CPDN Monitor - Quit request from BOINC... MonID=25014, UMPID=25017, RM3PID=0 CPDN Monitor - Quit request from BOINC... MonID=25278, UMPID=25280, RM3PID=0 CPDN Monitor - Quit request from BOINC... MonID=25584, UMPID=25586, RM3PID=0 CPDN Monitor - Quit request from BOINC... MonID=25977, UMPID=25979, RM3PID=0 CPDN Monitor - Quit request from BOINC... MonID=26246, UMPID=26248, RM3PID=0 CPDN Monitor - Quit request from BOINC... MonID=26468, UMPID=26470, RM3PID=0 CPDN Monitor - Quit request from BOINC... MonID=27727, UMPID=27730, RM3PID=0 10:36:26 (27727): No heartbeat from client for 30 sec - exiting 10:36:31 (27727): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... MonID=29028, UMPID=29031, RM3PID=0 CPDN Monitor - Quit request from BOINC... MonID=32174, UMPID=32183, RM3PID=0 SIGSEGV: segmentation violation Stack trace (14 frames): ../../projects/climateprediction.net/hadcm3s_7.24_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80bd86f] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf774e400] /lib/libc.so.6(getenv+0x6a)[0xf742df8a] /lib/libc.so.6(+0xac91a)[0xf74a991a] /lib/libc.so.6(+0xaccab)[0xf74a9cab] /lib/libc.so.6(localtime_r+0x2b)[0xf74a827b] ../../projects/climateprediction.net/hadcm3s_7.24_i686-pc-linux-gnu[0x80b8ea6] ../../projects/climateprediction.net/hadcm3s_7.24_i686-pc-linux-gnu[0x80b9356] ../../projects/climateprediction.net/hadcm3s_7.24_i686-pc-linux-gnu[0x804fbfb] ../../projects/climateprediction.net/hadcm3s_7.24_i686-pc-linux-gnu[0x805051b] ../../projects/climateprediction.net/hadcm3s_7.24_i686-pc-linux-gnu[0x80512eb] ../../projects/climateprediction.net/hadcm3s_7.24_i686-pc-linux-gnu[0x805153c] /lib/libc.so.6(__libc_start_main+0xf5)[0xf7416825] ../../projects/climateprediction.net/hadcm3s_7.24_i686-pc-linux-gnu(__gxx_personality_v0+0x191)[0x804cc91] Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Nov 2014 09:54:18	1266912	17264941	hadcm3s_42vg_1983_2_009122140_0	51,840	159,705	3.0807
05 Nov 2014 11:20:32	1266912	17264941	hadcm3s_42vg_1983_2_009122140_0	25,920	78,124	3.0140