Task 13103928

Name	hadcm3n_yd90_1900_40_007350030_1
Workunit	7547460
Created	6 Jul 2011, 14:03:03 UTC
Sent	17 Jul 2011, 6:25:52 UTC
Report deadline	16 Oct 2011, 13:53:03 UTC
Received	19 Jul 2011, 2:46:41 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	942621
Run time	1 days 0 hours 22 min 19 sec
CPU time	16 hours 5 min 6 sec
Validate state	Invalid
Credit	311.04
Device peak FLOPS	3.42 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.6.36</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:38:46 (35159): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:38:47 (35159): No heartbeat from core client for 30 sec - exiting 06:38:48 (35159): No heartbeat from core client for 30 sec - exiting 06:38:49 (35159): No heartbeat from core client for 30 sec - exiting 06:38:50 (35159): No heartbeat from core client for 30 sec - exiting 06:38:51 (35159): No heartbeat from core client for 30 sec - exiting 06:38:52 (35159): No heartbeat from core client for 30 sec - exiting 06:38:53 (35159): No heartbeat from core client for 30 sec - exiting 06:38:54 (35159): No heartbeat from core client for 30 sec - exiting 06:38:55 (35159): No heartbeat from core client for 30 sec - exiting 06:38:56 (35159): No heartbeat from core client for 30 sec - exiting 06:38:57 (35159): No heartbeat from core client for 30 sec - exiting 06:38:58 (35159): No heartbeat from core client for 30 sec - exiting 06:38:59 (35159): No heartbeat from core client for 30 sec - exiting 06:39:00 (35159): No heartbeat from core client for 30 sec - exiting 06:39:01 (35159): No heartbeat from core client for 30 sec - exiting 06:39:02 (35159): No heartbeat from core client for 30 sec - exiting 06:39:03 (35159): No heartbeat from core client for 30 sec - exiting 06:39:04 (35159): No heartbeat from core client for 30 sec - exiting 06:39:05 (35159): No heartbeat from core client for 30 sec - exiting 06:39:06 (35159): No heartbeat from core client for 30 sec - exiting 06:39:07 (35159): No heartbeat from core client for 30 sec - exiting 06:39:08 (35159): No heartbeat from core client for 30 sec - exiting 06:39:09 (35159): No heartbeat from core client for 30 sec - exiting 06:39:10 (35159): No heartbeat from core client for 30 sec - exiting 06:39:11 (35159): No heartbeat from core client for 30 sec - exiting 06:39:12 (35159): No heartbeat from core client for 30 sec - exiting 06:39:13 (35159): No heartbeat from core client for 30 sec - exiting 06:39:14 (35159): No heartbeat from core client for 30 sec - exiting 06:39:15 (35159): No heartbeat from core client for 30 sec - exiting 06:39:16 (35159): No heartbeat from core client for 30 sec - exiting 06:39:17 (35159): No heartbeat from core client for 30 sec - exiting 06:39:18 (35159): No heartbeat from core client for 30 sec - exiting 06:39:19 (35159): No heartbeat from core client for 30 sec - exiting 06:39:20 (35159): No heartbeat from core client for 30 sec - exiting 06:39:21 (35159): No heartbeat from core client for 30 sec - exiting 06:39:22 (35159): No heartbeat from core client for 30 sec - exiting 06:39:23 (35159): No heartbeat from core client for 30 sec - exiting 06:39:24 (35159): No heartbeat from core client for 30 sec - exiting 06:39:25 (35159): No heartbeat from core client for 30 sec - exiting 06:39:26 (35159): No heartbeat from core client for 30 sec - exiting 06:39:27 (35159): No heartbeat from core client for 30 sec - exiting 06:39:28 (35159): No heartbeat from core client for 30 sec - exiting 06:39:30 (35159): No heartbeat from core client for 30 sec - exiting 06:39:31 (35159): No heartbeat from core client for 30 sec - exiting 06:39:32 (35159): No heartbeat from core client for 30 sec - exiting 06:39:33 (35159): No heartbeat from core client for 30 sec - exiting 06:39:34 (35159): No heartbeat from core client for 30 sec - exiting 06:39:35 (35159): No heartbeat from core client for 30 sec - exiting 06:39:36 (35159): No heartbeat from core client for 30 sec - exiting 06:39:37 (35159): No heartbeat from core client for 30 sec - exiting 06:39:38 (35159): No heartbeat from core client for 30 sec - exiting 06:39:39 (35159): No heartbeat from core client for 30 sec - exiting 06:39:40 (35159): No heartbeat from core client for 30 sec - exiting 06:39:41 (35159): No heartbeat from core client for 30 sec - exiting 06:39:42 (35159): No heartbeat from core client for 30 sec - exiting 06:39:43 (35159): No heartbeat from core client for 30 sec - exiting 06:39:44 (35159): No heartbeat from core client for 30 sec - exiting 06:39:45 (35159): No heartbeat from core client for 30 sec - exiting 06:39:46 (35159): No heartbeat from core client for 30 sec - exiting 06:39:47 (35159): No heartbeat from core client for 30 sec - exiting 06:39:48 (35159): No heartbeat from core client for 30 sec - exiting 06:39:49 (35159): No heartbeat from core client for 30 sec - exiting 06:39:50 (35159): No heartbeat from core client for 30 sec - exiting 06:39:51 (35159): No heartbeat from core client for 30 sec - exiting 06:39:52 (35159): No heartbeat from core client for 30 sec - exiting 06:39:53 (35159): No heartbeat from core client for 30 sec - exiting 06:39:54 (35159): No heartbeat from core client for 30 sec - exiting 06:39:55 (35159): No heartbeat from core client for 30 sec - exiting 06:39:56 (35159): No heartbeat from core client for 30 sec - exiting 06:39:57 (35159): No heartbeat from core client for 30 sec - exiting 06:39:58 (35159): No heartbeat from core client for 30 sec - exiting 06:39:59 (35159): No heartbeat from core client for 30 sec - exiting 06:40:00 (35159): No heartbeat from core client for 30 sec - exiting 06:40:01 (35159): No heartbeat from core client for 30 sec - exiting 06:40:02 (35159): No heartbeat from core client for 30 sec - exiting 06:40:03 (35159): No heartbeat from core client for 30 sec - exiting 06:40:04 (35159): No heartbeat from core client for 30 sec - exiting 06:40:05 (35159): No heartbeat from core client for 30 sec - exiting 06:40:06 (35159): No heartbeat from core client for 30 sec - exiting 06:40:07 (35159): No heartbeat from core client for 30 sec - exiting 06:40:08 (35159): No heartbeat from core client for 30 sec - exiting 06:40:09 (35159): No heartbeat from core client for 30 sec - exiting 06:40:10 (35159): No heartbeat from core client for 30 sec - exiting 06:40:11 (35159): No heartbeat from core client for 30 sec - exiting 06:40:12 (35159): No heartbeat from core client for 30 sec - exiting 06:40:13 (35159): No heartbeat from core client for 30 sec - exiting 06:40:14 (35159): No heartbeat from core client for 30 sec - exiting 06:40:15 (35159): No heartbeat from core client for 30 sec - exiting 06:40:16 (35159): No heartbeat from core client for 30 sec - exiting 06:40:17 (35159): No heartbeat from core client for 30 sec - exiting 06:40:18 (35159): No heartbeat from core client for 30 sec - exiting 06:40:19 (35159): No heartbeat from core client for 30 sec - exiting 06:40:20 (35159): No heartbeat from core client for 30 sec - exiting 06:40:21 (35159): No heartbeat from core client for 30 sec - exiting 06:40:22 (35159): No heartbeat from core client for 30 sec - exiting 06:40:23 (35159): No heartbeat from core client for 30 sec - exiting 06:40:24 (35159): No heartbeat from core client for 30 sec - exiting 06:40:25 (35159): No heartbeat from core client for 30 sec - exiting 06:40:26 (35159): No heartbeat from core client for 30 sec - exiting 06:40:27 (35159): No heartbeat from core client for 30 sec - exiting 06:40:28 (35159): No heartbeat from core client for 30 sec - exiting 06:40:29 (35159): No heartbeat from core client for 30 sec - exiting 06:40:30 (35159): No heartbeat from core client for 30 sec - exiting 06:40:31 (35159): No heartbeat from core client for 30 sec - exiting 06:40:32 (35159): No heartbeat from core client for 30 sec - exiting 06:40:33 (35159): No heartbeat from core client for 30 sec - exiting 06:40:34 (35159): No heartbeat from core client for 30 sec - exiting 06:40:35 (35159): No heartbeat from core client for 30 sec - exiting 06:40:36 (35159): No heartbeat from core client for 30 sec - exiting 06:40:38 (35159): No heartbeat from core client for 30 sec - exiting 06:40:39 (35159): No heartbeat from core client for 30 sec - exiting 06:40:40 (35159): No heartbeat from core client for 30 sec - exiting 06:40:41 (35159): No heartbeat from core client for 30 sec - exiting 06:40:42 (35159): No heartbeat from core client for 30 sec - exiting 06:40:43 (35159): No heartbeat from core client for 30 sec - exiting 06:40:44 (35159): No heartbeat from core client for 30 sec - exiting 06:40:45 (35159): No heartbeat from core client for 30 sec - exiting 06:40:46 (35159): No heartbeat from core client for 30 sec - exiting 06:40:47 (35159): No heartbeat from core client for 30 sec - exiting 06:40:48 (35159): No heartbeat from core client for 30 sec - exiting 06:40:49 (35159): No heartbeat from core client for 30 sec - exiting 06:40:50 (35159): No heartbeat from core client for 30 sec - exiting 06:40:51 (35159): No heartbeat from core client for 30 sec - exiting 06:40:52 (35159): No heartbeat from core client for 30 sec - exiting 06:40:53 (35159): No heartbeat from core client for 30 sec - exiting 06:40:54 (35159): No heartbeat from core client for 30 sec - exiting 06:40:55 (35159): No heartbeat from core client for 30 sec - exiting 06:40:56 (35159): No heartbeat from core client for 30 sec - exiting 06:40:57 (35159): No heartbeat from core client for 30 sec - exiting 06:40:58 (35159): No heartbeat from core client for 30 sec - exiting 06:40:59 (35159): No heartbeat from core client for 30 sec - exiting 06:41:00 (35159): No heartbeat from core client for 30 sec - exiting 06:41:01 (35159): No heartbeat from core client for 30 sec - exiting 06:41:02 (35159): No heartbeat from core client for 30 sec - exiting 06:41:03 (35159): No heartbeat from core client for 30 sec - exiting 06:41:04 (35159): No heartbeat from core client for 30 sec - exiting 06:41:05 (35159): No heartbeat from core client for 30 sec - exiting 06:41:06 (35159): No heartbeat from core client for 30 sec - exiting 06:41:07 (35159): No heartbeat from core client for 30 sec - exiting 06:41:08 (35159): No heartbeat from core client for 30 sec - exiting 06:41:09 (35159): No heartbeat from core client for 30 sec - exiting 06:41:10 (35159): No heartbeat from core client for 30 sec - exiting 06:41:11 (35159): No heartbeat from core client for 30 sec - exiting 06:41:12 (35159): No heartbeat from core client for 30 sec - exiting 06:41:13 (35159): No heartbeat from core client for 30 sec - exiting 06:41:14 (35159): No heartbeat from core client for 30 sec - exiting 06:41:15 (35159): No heartbeat from core client for 30 sec - exiting 06:41:16 (35159): No heartbeat from core client for 30 sec - exiting 06:41:17 (35159): No heartbeat from core client for 30 sec - exiting 06:41:18 (35159): No heartbeat from core client for 30 sec - exiting 06:41:19 (35159): No heartbeat from core client for 30 sec - exiting 06:41:20 (35159): No heartbeat from core client for 30 sec - exiting 06:41:21 (35159): No heartbeat from core client for 30 sec - exiting 06:41:22 (35159): No heartbeat from core client for 30 sec - exiting 06:41:23 (35159): No heartbeat from core client for 30 sec - exiting 06:41:24 (35159): No heartbeat from core client for 30 sec - exiting 06:41:25 (35159): No heartbeat from core client for 30 sec - exiting 06:41:26 (35159): No heartbeat from core client for 30 sec - exiting 06:41:27 (35159): No heartbeat from core client for 30 sec - exiting 06:41:28 (35159): No heartbeat from core client for 30 sec - exiting 06:41:29 (35159): No heartbeat from core client for 30 sec - exiting 06:41:30 (35159): No heartbeat from core client for 30 sec - exiting 06:41:31 (35159): No heartbeat from core client for 30 sec - exiting 06:41:32 (35159): No heartbeat from core client for 30 sec - exiting 06:41:33 (35159): No heartbeat from core client for 30 sec - exiting 06:41:34 (35159): No heartbeat from core client for 30 sec - exiting 06:41:35 (35159): No heartbeat from core client for 30 sec - exiting 06:41:36 (35159): No heartbeat from core client for 30 sec - exiting 06:41:37 (35159): No heartbeat from core client for 30 sec - exiting 06:41:38 (35159): No heartbeat from core client for 30 sec - exiting 06:41:39 (35159): No heartbeat from core client for 30 sec - exiting 06:41:40 (35159): No heartbeat from core client for 30 sec - exiting 06:41:41 (35159): No heartbeat from core client for 30 sec - exiting 06:41:42 (35159): No heartbeat from core client for 30 sec - exiting 06:41:43 (35159): No heartbeat from core client for 30 sec - exiting 06:41:44 (35159): No heartbeat from core client for 30 sec - exiting 06:41:45 (35159): No heartbeat from core client for 30 sec - exiting 06:41:47 (35159): No heartbeat from core client for 30 sec - exiting 06:41:48 (35159): No heartbeat from core client for 30 sec - exiting 06:41:49 (35159): No heartbeat from core client for 30 sec - exiting 06:41:50 (35159): No heartbeat from core client for 30 sec - exiting 06:41:51 (35159): No heartbeat from core client for 30 sec - exiting 06:41:52 (35159): No heartbeat from core client for 30 sec - exiting 06:41:53 (35159): No heartbeat from core client for 30 sec - exiting 06:41:54 (35159): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:37:21 (53806): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:39:55 (54352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... 02:39:41 (55346): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:39:42 (55346): No heartbeat from core client for 30 sec - exiting 02:39:43 (55346): No heartbeat from core client for 30 sec - exiting 02:39:44 (55346): No heartbeat from core client for 30 sec - exiting 02:39:45 (55346): No heartbeat from core client for 30 sec - exiting 02:39:46 (55346): No heartbeat from core client for 30 sec - exiting 02:39:47 (55346): No heartbeat from core client for 30 sec - exiting 02:39:48 (55346): No heartbeat from core client for 30 sec - exiting 02:39:49 (55346): No heartbeat from core client for 30 sec - exiting 02:39:50 (55346): No heartbeat from core client for 30 sec - exiting 02:39:51 (55346): No heartbeat from core client for 30 sec - exiting 02:39:52 (55346): No heartbeat from core client for 30 sec - exiting 02:39:53 (55346): No heartbeat from core client for 30 sec - exiting 02:39:54 (55346): No heartbeat from core client for 30 sec - exiting 02:39:55 (55346): No heartbeat from core client for 30 sec - exiting 02:39:56 (55346): No heartbeat from core client for 30 sec - exiting 02:39:57 (55346): No heartbeat from core client for 30 sec - exiting 02:39:58 (55346): No heartbeat from core client for 30 sec - exiting 02:39:59 (55346): No heartbeat from core client for 30 sec - exiting 02:40:00 (55346): No heartbeat from core client for 30 sec - exiting 02:40:01 (55346): No heartbeat from core client for 30 sec - exiting 02:45:28 (58505): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:57:00 (58604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:07:46 (58792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 03:15:59 (58944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:24:58 (59110): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 03:39:07 (59269): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.8 build 10K540 Tue Jul 19 03:39:58 2011 Thread 0 Crashed: 0 libSystem.B.dylib 0x981afc5a ___kill + 10 1 libSystem.B.dylib 0x982425a5 _raise + 26 2 libSystem.B.dylib 0x982586e4 _abort + 93 3 hadcm3n_um_6.07_i686-apple-darwin 0x00336cff _um_setup + 127 4 hadcm3n_um_6.07_i686-apple-darwin 0x00389b71 _um_shell + 3953 5 hadcm3n_um_6.07_i686-apple-darwin 0x000048e1 _main + 1153 6 hadcm3n_um_6.07_i686-apple-darwin 0x000027fb __start + 209 7 hadcm3n_um_6.07_i686-apple-darwin 0x00002729 start + 41 Thread 1: 0 libSystem.B.dylib 0x9814ec0e _mach_wait_until + 10 1 libSystem.B.dylib 0x981d6429 _nanosleep + 345 2 libSystem.B.dylib 0x981d62ca _usleep + 61 3 hadcm3n_um_6.07_i686-apple-darwin 0x00442ec0 __Z11boinc_sleepd + 188 4 hadcm3n_um_6.07_i686-apple-darwin 0x0043865e __Z12timer_threadPv + 78 5 libSystem.B.dylib 0x9817c259 __pthread_start + 345 6 libSystem.B.dylib 0x9817c0de _thread_start + 34 Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc9c8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x944f8000 - 0x94506fff /usr/lib/libz.1.dylib 0x95749000 - 0x9574cfff /usr/lib/system/libmathCommon.A.dylib 0x9814e000 - 0x982f5fff /usr/lib/libSystem.B.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=59471, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.8 build 10K540 Tue Jul 19 03:40:01 2011 Thread 0 Crashed: 0 libSystem.B.dylib 0x981afc5a ___kill + 10 1 libSystem.B.dylib 0x982425a5 _raise + 26 2 libSystem.B.dylib 0x982586e4 _abort + 93 3 hadcm3n_um_6.07_i686-apple-darwin 0x00336cff _um_setup + 127 4 hadcm3n_um_6.07_i686-apple-darwin 0x00389b71 _um_shell + 3953 5 hadcm3n_um_6.07_i686-apple-darwin 0x000048e1 _main + 1153 6 hadcm3n_um_6.07_i686-apple-darwin 0x000027fb __start + 209 7 hadcm3n_um_6.07_i686-apple-darwin 0x00002729 start + 41 Thread 1: 0 libSystem.B.dylib 0x9814ec0e _mach_wait_until + 10 1 libSystem.B.dylib 0x981d6429 _nanosleep + 345 2 libSystem.B.dylib 0x981d62ca _usleep + 61 3 hadcm3n_um_6.07_i686-apple-darwin 0x00442ec0 __Z11boinc_sleepd + 188 4 hadcm3n_um_6.07_i686-apple-darwin 0x0043865e __Z12timer_threadPv + 78 5 libSystem.B.dylib 0x9817c259 __pthread_start + 345 6 libSystem.B.dylib 0x9817c0de _thread_start + 34 Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc9c8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x944f8000 - 0x94506fff /usr/lib/libz.1.dylib 0x95749000 - 0x9574cfff /usr/lib/system/libmathCommon.A.dylib 0x9814e000 - 0x982f5fff /usr/lib/libSystem.B.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=59471, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.8 build 10K540 Tue Jul 19 03:40:04 2011 Thread 0 Crashed: 0 libSystem.B.dylib 0x981afc5a ___kill + 10 1 libSystem.B.dylib 0x982425a5 _raise + 26 2 libSystem.B.dylib 0x982586e4 _abort + 93 3 hadcm3n_um_6.07_i686-apple-darwin 0x00336cff _um_setup + 127 4 hadcm3n_um_6.07_i686-apple-darwin 0x00389b71 _um_shell + 3953 5 hadcm3n_um_6.07_i686-apple-darwin 0x000048e1 _main + 1153 6 hadcm3n_um_6.07_i686-apple-darwin 0x000027fb __start + 209 7 hadcm3n_um_6.07_i686-apple-darwin 0x00002729 start + 41 Thread 1: 0 libSystem.B.dylib 0x9814ec0e _mach_wait_until + 10 1 libSystem.B.dylib 0x981d6429 _nanosleep + 345 2 libSystem.B.dylib 0x981d62ca _usleep + 61 3 hadcm3n_um_6.07_i686-apple-darwin 0x00442ec0 __Z11boinc_sleepd + 188 4 hadcm3n_um_6.07_i686-apple-darwin 0x0043865e __Z12timer_threadPv + 78 5 libSystem.B.dylib 0x9817c259 __pthread_start + 345 6 libSystem.B.dylib 0x9817c0de _thread_start + 34 Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc9c8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x944f8000 - 0x94506fff /usr/lib/libz.1.dylib 0x95749000 - 0x9574cfff /usr/lib/system/libmathCommon.A.dylib 0x9814e000 - 0x982f5fff /usr/lib/libSystem.B.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=59471, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.8 build 10K540 Tue Jul 19 03:40:07 2011 Thread 0 Crashed: 0 libSystem.B.dylib 0x981afc5a ___kill + 10 1 libSystem.B.dylib 0x982425a5 _raise + 26 2 libSystem.B.dylib 0x982586e4 _abort + 93 3 hadcm3n_um_6.07_i686-apple-darwin 0x00336cff _um_setup + 127 4 hadcm3n_um_6.07_i686-apple-darwin 0x00389b71 _um_shell + 3953 5 hadcm3n_um_6.07_i686-apple-darwin 0x000048e1 _main + 1153 6 hadcm3n_um_6.07_i686-apple-darwin 0x000027fb __start + 209 7 hadcm3n_um_6.07_i686-apple-darwin 0x00002729 start + 41 Thread 1: 0 libSystem.B.dylib 0x9814ec0e _mach_wait_until + 10 1 libSystem.B.dylib 0x981d6429 _nanosleep + 345 2 libSystem.B.dylib 0x981d62ca _usleep + 61 3 hadcm3n_um_6.07_i686-apple-darwin 0x00442ec0 __Z11boinc_sleepd + 188 4 hadcm3n_um_6.07_i686-apple-darwin 0x0043865e __Z12timer_threadPv + 78 5 libSystem.B.dylib 0x9817c259 __pthread_start + 345 6 libSystem.B.dylib 0x9817c0de _thread_start + 34 Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc9c8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x944f8000 - 0x94506fff /usr/lib/libz.1.dylib 0x95749000 - 0x9574cfff /usr/lib/system/libmathCommon.A.dylib 0x9814e000 - 0x982f5fff /usr/lib/libSystem.B.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=59471, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.8 build 10K540 Tue Jul 19 03:40:09 2011 Thread 0 Crashed: 0 libSystem.B.dylib 0x981afc5a ___kill + 10 1 libSystem.B.dylib 0x982425a5 _raise + 26 2 libSystem.B.dylib 0x982586e4 _abort + 93 3 hadcm3n_um_6.07_i686-apple-darwin 0x00336cff _um_setup + 127 4 hadcm3n_um_6.07_i686-apple-darwin 0x00389b71 _um_shell + 3953 5 hadcm3n_um_6.07_i686-apple-darwin 0x000048e1 _main + 1153 6 hadcm3n_um_6.07_i686-apple-darwin 0x000027fb __start + 209 7 hadcm3n_um_6.07_i686-apple-darwin 0x00002729 start + 41 Thread 1: 0 libSystem.B.dylib 0x9814ec0e _mach_wait_until + 10 1 libSystem.B.dylib 0x981d6429 _nanosleep + 345 2 libSystem.B.dylib 0x981d62ca _usleep + 61 3 hadcm3n_um_6.07_i686-apple-darwin 0x00442ec0 __Z11boinc_sleepd + 188 4 hadcm3n_um_6.07_i686-apple-darwin 0x0043865e __Z12timer_threadPv + 78 5 libSystem.B.dylib 0x9817c259 __pthread_start + 345 6 libSystem.B.dylib 0x9817c0de _thread_start + 34 Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc9c8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x944f8000 - 0x94506fff /usr/lib/libz.1.dylib 0x95749000 - 0x9574cfff /usr/lib/system/libmathCommon.A.dylib 0x9814e000 - 0x982f5fff /usr/lib/libSystem.B.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=59471, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.8 build 10K540 Tue Jul 19 03:40:12 2011 Thread 0 Crashed: 0 libSystem.B.dylib 0x981afc5a ___kill + 10 1 libSystem.B.dylib 0x982425a5 _raise + 26 2 libSystem.B.dylib 0x982586e4 _abort + 93 3 hadcm3n_um_6.07_i686-apple-darwin 0x00336cff _um_setup + 127 4 hadcm3n_um_6.07_i686-apple-darwin 0x00389b71 _um_shell + 3953 5 hadcm3n_um_6.07_i686-apple-darwin 0x000048e1 _main + 1153 6 hadcm3n_um_6.07_i686-apple-darwin 0x000027fb __start + 209 7 hadcm3n_um_6.07_i686-apple-darwin 0x00002729 start + 41 Thread 1: 0 libSystem.B.dylib 0x9814ec0e _mach_wait_until + 10 1 libSystem.B.dylib 0x981d6429 _nanosleep + 345 2 libSystem.B.dylib 0x981d62ca _usleep + 61 3 hadcm3n_um_6.07_i686-apple-darwin 0x00442ec0 __Z11boinc_sleepd + 188 4 hadcm3n_um_6.07_i686-apple-darwin 0x0043865e __Z12timer_threadPv + 78 5 libSystem.B.dylib 0x9817c259 __pthread_start + 345 6 libSystem.B.dylib 0x9817c0de _thread_start + 34 Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc9c8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x944f8000 - 0x94506fff /usr/lib/libz.1.dylib 0x95749000 - 0x9574cfff /usr/lib/system/libmathCommon.A.dylib 0x9814e000 - 0x982f5fff /usr/lib/libSystem.B.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=59471, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Jul 2011 17:35:41	942621	13103928	hadcm3n_yd90_1900_40_007350030_1	25,920	42,484	1.6390