Task 15773623

Name	hadcm3n_3eoo_1980_40_008364215_0
Workunit	8515074
Created	10 May 2013, 19:35:48 UTC
Sent	10 May 2013, 20:00:11 UTC
Report deadline	10 Aug 2013, 3:27:22 UTC
Received	12 May 2013, 18:27:52 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1282911
Run time	1 days 17 hours 41 min 53 sec
CPU time	1 days 15 hours 45 min 25 sec
Validate state	Invalid
Credit	622.08
Device peak FLOPS	2.00 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>7.0.27</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> 00:55:16 (11590): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:59:35 (11762): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:03:44 (12053): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:03:45 (12053): No heartbeat from core client for 30 sec - exiting 01:03:46 (12053): No heartbeat from core client for 30 sec - exiting 01:07:31 (12153): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:07:32 (12153): No heartbeat from core client for 30 sec - exiting 01:07:33 (12153): No heartbeat from core client for 30 sec - exiting 01:07:34 (12153): No heartbeat from core client for 30 sec - exiting 01:07:35 (12153): No heartbeat from core client for 30 sec - exiting 01:07:36 (12153): No heartbeat from core client for 30 sec - exiting 01:07:37 (12153): No heartbeat from core client for 30 sec - exiting 01:07:38 (12153): No heartbeat from core client for 30 sec - exiting 01:07:39 (12153): No heartbeat from core client for 30 sec - exiting 01:07:40 (12153): No heartbeat from core client for 30 sec - exiting 01:07:41 (12153): No heartbeat from core client for 30 sec - exiting 01:07:42 (12153): No heartbeat from core client for 30 sec - exiting 01:07:43 (12153): No heartbeat from core client for 30 sec - exiting 01:07:44 (12153): No heartbeat from core client for 30 sec - exiting 01:07:45 (12153): No heartbeat from core client for 30 sec - exiting 01:07:46 (12153): No heartbeat from core client for 30 sec - exiting 01:07:47 (12153): No heartbeat from core client for 30 sec - exiting 01:07:48 (12153): No heartbeat from core client for 30 sec - exiting 01:07:49 (12153): No heartbeat from core client for 30 sec - exiting 01:12:07 (12252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:12:08 (12252): No heartbeat from core client for 30 sec - exiting 01:12:09 (12252): No heartbeat from core client for 30 sec - exiting 01:12:10 (12252): No heartbeat from core client for 30 sec - exiting 01:12:11 (12252): No heartbeat from core client for 30 sec - exiting 01:12:12 (12252): No heartbeat from core client for 30 sec - exiting 01:12:13 (12252): No heartbeat from core client for 30 sec - exiting 01:12:14 (12252): No heartbeat from core client for 30 sec - exiting 01:16:15 (12348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:16:16 (12348): No heartbeat from core client for 30 sec - exiting 01:16:17 (12348): No heartbeat from core client for 30 sec - exiting 01:16:18 (12348): No heartbeat from core client for 30 sec - exiting 01:16:19 (12348): No heartbeat from core client for 30 sec - exiting 01:16:20 (12348): No heartbeat from core client for 30 sec - exiting 01:16:21 (12348): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 01:20:14 (12448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:20:15 (12448): No heartbeat from core client for 30 sec - exiting 01:20:17 (12448): No heartbeat from core client for 30 sec - exiting 01:20:18 (12448): No heartbeat from core client for 30 sec - exiting 01:20:19 (12448): No heartbeat from core client for 30 sec - exiting 01:20:20 (12448): No heartbeat from core client for 30 sec - exiting 01:20:21 (12448): No heartbeat from core client for 30 sec - exiting 01:20:22 (12448): No heartbeat from core client for 30 sec - exiting 01:20:23 (12448): No heartbeat from core client for 30 sec - exiting 01:20:24 (12448): No heartbeat from core client for 30 sec - exiting 03:22:16 (12545): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:26:25 (12661): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:26:26 (12661): No heartbeat from core client for 30 sec - exiting 03:30:10 (12761): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:30:11 (12761): No heartbeat from core client for 30 sec - exiting 03:30:12 (12761): No heartbeat from core client for 30 sec - exiting 03:30:13 (12761): No heartbeat from core client for 30 sec - exiting 03:30:14 (12761): No heartbeat from core client for 30 sec - exiting 03:30:15 (12761): No heartbeat from core client for 30 sec - exiting 03:30:16 (12761): No heartbeat from core client for 30 sec - exiting 03:30:17 (12761): No heartbeat from core client for 30 sec - exiting 03:41:30 (12853): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:41:31 (12853): No heartbeat from core client for 30 sec - exiting 03:41:32 (12853): No heartbeat from core client for 30 sec - exiting 03:41:33 (12853): No heartbeat from core client for 30 sec - exiting 03:41:34 (12853): No heartbeat from core client for 30 sec - exiting 03:45:27 (12946): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:49:26 (13029): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:53:27 (13113): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:20:44 (13197): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:20:45 (13197): No heartbeat from core client for 30 sec - exiting 04:24:33 (13328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:24:34 (13328): No heartbeat from core client for 30 sec - exiting 04:24:35 (13328): No heartbeat from core client for 30 sec - exiting 04:24:36 (13328): No heartbeat from core client for 30 sec - exiting 04:24:37 (13328): No heartbeat from core client for 30 sec - exiting 04:28:35 (13420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:33:08 (13512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:33:09 (13512): No heartbeat from core client for 30 sec - exiting 04:33:10 (13512): No heartbeat from core client for 30 sec - exiting 04:33:11 (13512): No heartbeat from core client for 30 sec - exiting 04:33:12 (13512): No heartbeat from core client for 30 sec - exiting 04:33:13 (13512): No heartbeat from core client for 30 sec - exiting 04:33:14 (13512): No heartbeat from core client for 30 sec - exiting 04:33:15 (13512): No heartbeat from core client for 30 sec - exiting 04:36:44 (13588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:44:30 (13687): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:44:31 (13687): No heartbeat from core client for 30 sec - exiting 04:44:32 (13687): No heartbeat from core client for 30 sec - exiting 04:44:33 (13687): No heartbeat from core client for 30 sec - exiting 04:44:34 (13687): No heartbeat from core client for 30 sec - exiting 04:44:35 (13687): No heartbeat from core client for 30 sec - exiting 04:44:36 (13687): No heartbeat from core client for 30 sec - exiting 04:44:37 (13687): No heartbeat from core client for 30 sec - exiting 04:44:38 (13687): No heartbeat from core client for 30 sec - exiting 04:44:39 (13687): No heartbeat from core client for 30 sec - exiting 04:44:40 (13687): No heartbeat from core client for 30 sec - exiting 04:44:41 (13687): No heartbeat from core client for 30 sec - exiting 04:44:42 (13687): No heartbeat from core client for 30 sec - exiting 04:44:43 (13687): No heartbeat from core client for 30 sec - exiting 06:47:10 (13771): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:47:11 (13771): No heartbeat from core client for 30 sec - exiting 06:47:12 (13771): No heartbeat from core client for 30 sec - exiting 06:47:13 (13771): No heartbeat from core client for 30 sec - exiting 06:47:14 (13771): No heartbeat from core client for 30 sec - exiting 06:47:15 (13771): No heartbeat from core client for 30 sec - exiting 06:47:16 (13771): No heartbeat from core client for 30 sec - exiting 06:51:09 (13928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:12:18 (14004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:55:34 (14870): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:59:35 (15063): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:59:36 (15063): No heartbeat from core client for 30 sec - exiting 05:59:37 (15063): No heartbeat from core client for 30 sec - exiting 06:03:29 (15186): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:03:30 (15186): No heartbeat from core client for 30 sec - exiting 06:03:31 (15186): No heartbeat from core client for 30 sec - exiting 06:03:32 (15186): No heartbeat from core client for 30 sec - exiting 06:07:42 (15289): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:06:18 (15374): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:09:58 (16016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:13:43 (16092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:13:44 (16092): No heartbeat from core client for 30 sec - exiting 18:13:45 (16092): No heartbeat from core client for 30 sec - exiting 18:17:25 (16172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:17:26 (16172): No heartbeat from core client for 30 sec - exiting 18:17:27 (16172): No heartbeat from core client for 30 sec - exiting 18:17:28 (16172): No heartbeat from core client for 30 sec - exiting 18:17:29 (16172): No heartbeat from core client for 30 sec - exiting 18:17:30 (16172): No heartbeat from core client for 30 sec - exiting 18:17:31 (16172): No heartbeat from core client for 30 sec - exiting 18:17:32 (16172): No heartbeat from core client for 30 sec - exiting 18:17:33 (16172): No heartbeat from core client for 30 sec - exiting 18:17:34 (16172): No heartbeat from core client for 30 sec - exiting 18:17:35 (16172): No heartbeat from core client for 30 sec - exiting 18:17:36 (16172): No heartbeat from core client for 30 sec - exiting 18:17:37 (16172): No heartbeat from core client for 30 sec - exiting 18:17:38 (16172): No heartbeat from core client for 30 sec - exiting 18:17:39 (16172): No heartbeat from core client for 30 sec - exiting 18:17:40 (16172): No heartbeat from core client for 30 sec - exiting 18:17:41 (16172): No heartbeat from core client for 30 sec - exiting 18:17:42 (16172): No heartbeat from core client for 30 sec - exiting 18:21:14 (16255): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:21:15 (16255): No heartbeat from core client for 30 sec - exiting 18:21:16 (16255): No heartbeat from core client for 30 sec - exiting 18:21:17 (16255): No heartbeat from core client for 30 sec - exiting 18:21:18 (16255): No heartbeat from core client for 30 sec - exiting 18:21:19 (16255): No heartbeat from core client for 30 sec - exiting 18:21:20 (16255): No heartbeat from core client for 30 sec - exiting 18:21:21 (16255): No heartbeat from core client for 30 sec - exiting 18:21:22 (16255): No heartbeat from core client for 30 sec - exiting 18:21:23 (16255): No heartbeat from core client for 30 sec - exiting 18:21:24 (16255): No heartbeat from core client for 30 sec - exiting 18:21:25 (16255): No heartbeat from core client for 30 sec - exiting 18:21:26 (16255): No heartbeat from core client for 30 sec - exiting 18:25:12 (16335): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:25:13 (16335): No heartbeat from core client for 30 sec - exiting 18:25:14 (16335): No heartbeat from core client for 30 sec - exiting 18:25:15 (16335): No heartbeat from core client for 30 sec - exiting 18:25:16 (16335): No heartbeat from core client for 30 sec - exiting 18:25:17 (16335): No heartbeat from core client for 30 sec - exiting 18:25:18 (16335): No heartbeat from core client for 30 sec - exiting 18:25:19 (16335): No heartbeat from core client for 30 sec - exiting 18:25:20 (16335): No heartbeat from core client for 30 sec - exiting 18:25:21 (16335): No heartbeat from core client for 30 sec - exiting 18:25:22 (16335): No heartbeat from core client for 30 sec - exiting 18:25:23 (16335): No heartbeat from core client for 30 sec - exiting 18:25:24 (16335): No heartbeat from core client for 30 sec - exiting 18:25:25 (16335): No heartbeat from core client for 30 sec - exiting 18:25:26 (16335): No heartbeat from core client for 30 sec - exiting 18:25:27 (16335): No heartbeat from core client for 30 sec - exiting 18:25:28 (16335): No heartbeat from core client for 30 sec - exiting 18:25:29 (16335): No heartbeat from core client for 30 sec - exiting 18:25:30 (16335): No heartbeat from core client for 30 sec - exiting 18:25:31 (16335): No heartbeat from core client for 30 sec - exiting 18:25:32 (16335): No heartbeat from core client for 30 sec - exiting 18:25:33 (16335): No heartbeat from core client for 30 sec - exiting 18:25:34 (16335): No heartbeat from core client for 30 sec - exiting 18:29:06 (16415): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:29:12 (16415): No heartbeat from core client for 30 sec - exiting 18:32:55 (16499): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:32:56 (16499): No heartbeat from core client for 30 sec - exiting 18:32:57 (16499): No heartbeat from core client for 30 sec - exiting 18:32:58 (16499): No heartbeat from core client for 30 sec - exiting 18:32:59 (16499): No heartbeat from core client for 30 sec - exiting 18:33:00 (16499): No heartbeat from core client for 30 sec - exiting 18:33:01 (16499): No heartbeat from core client for 30 sec - exiting 18:33:02 (16499): No heartbeat from core client for 30 sec - exiting 18:33:03 (16499): No heartbeat from core client for 30 sec - exiting 18:33:04 (16499): No heartbeat from core client for 30 sec - exiting 18:33:05 (16499): No heartbeat from core client for 30 sec - exiting 18:33:06 (16499): No heartbeat from core client for 30 sec - exiting 18:33:07 (16499): No heartbeat from core client for 30 sec - exiting 18:33:08 (16499): No heartbeat from core client for 30 sec - exiting 18:33:09 (16499): No heartbeat from core client for 30 sec - exiting 18:33:10 (16499): No heartbeat from core client for 30 sec - exiting 18:33:11 (16499): No heartbeat from core client for 30 sec - exiting 18:33:12 (16499): No heartbeat from core client for 30 sec - exiting 18:33:13 (16499): No heartbeat from core client for 30 sec - exiting 18:36:46 (16587): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:36:47 (16587): No heartbeat from core client for 30 sec - exiting 18:36:48 (16587): No heartbeat from core client for 30 sec - exiting 18:36:49 (16587): No heartbeat from core client for 30 sec - exiting 18:36:50 (16587): No heartbeat from core client for 30 sec - exiting 18:36:51 (16587): No heartbeat from core client for 30 sec - exiting 18:40:34 (16665): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:40:35 (16665): No heartbeat from core client for 30 sec - exiting 18:40:36 (16665): No heartbeat from core client for 30 sec - exiting 18:40:37 (16665): No heartbeat from core client for 30 sec - exiting 18:40:38 (16665): No heartbeat from core client for 30 sec - exiting 18:40:39 (16665): No heartbeat from core client for 30 sec - exiting 18:40:40 (16665): No heartbeat from core client for 30 sec - exiting 18:40:41 (16665): No heartbeat from core client for 30 sec - exiting 18:40:42 (16665): No heartbeat from core client for 30 sec - exiting 18:40:43 (16665): No heartbeat from core client for 30 sec - exiting 18:40:44 (16665): No heartbeat from core client for 30 sec - exiting 18:40:45 (16665): No heartbeat from core client for 30 sec - exiting SIGABRT: abort called Stack trace (9 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf7763400] [0xf7763425] /lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75801df] /lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf7583825] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf756b4d3] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=16717, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf7718400] [0xf7718425] /lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75351df] /lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf7538825] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75204d3] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=16717, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf76f0400] [0xf76f0425] /lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf750d1df] /lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf7510825] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf74f84d3] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=16717, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf77b6400] [0xf77b6425] /lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75d31df] /lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf75d6825] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75be4d3] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=16717, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf77bb400] [0xf77bb425] /lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75d81df] /lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf75db825] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75c34d3] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=16717, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf7759400] [0xf7759425] /lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75761df] /lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf7579825] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75614d3] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=16717, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
12 May 2013 11:47:02	1281428	15773623	hadcm3n_3eoo_1980_40_008364215_0	51,840	122,229	2.3578
11 May 2013 16:46:32	1281428	15773623	hadcm3n_3eoo_1980_40_008364215_0	25,920	61,054	2.3555