Task 12929114

Name	hadcm3n_o18j_1940_40_007267728_0
Workunit	7465968
Created	3 Jun 2011, 5:16:15 UTC
Sent	3 Jun 2011, 5:16:30 UTC
Report deadline	2 Sep 2011, 12:43:41 UTC
Received	23 Jun 2011, 17:57:05 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1136618
Run time	7 days 22 hours 36 min 58 sec
CPU time	7 days 0 hours 53 min 30 sec
Validate state	Invalid
Credit	5,598.72
Device peak FLOPS	2.84 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:22:00 (313): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:23:15 (314): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:23:16 (314): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:03:18 (4757): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:03:19 (4757): No heartbeat from core client for 30 sec - exiting 03:03:20 (4757): No heartbeat from core client for 30 sec - exiting 03:03:21 (4757): No heartbeat from core client for 30 sec - exiting 03:03:22 (4757): No heartbeat from core client for 30 sec - exiting 03:03:23 (4757): No heartbeat from core client for 30 sec - exiting 03:03:24 (4757): No heartbeat from core client for 30 sec - exiting 03:03:25 (4757): No heartbeat from core client for 30 sec - exiting 03:03:26 (4757): No heartbeat from core client for 30 sec - exiting 03:03:27 (4757): No heartbeat from core client for 30 sec - exiting 03:03:28 (4757): No heartbeat from core client for 30 sec - exiting 03:03:29 (4757): No heartbeat from core client for 30 sec - exiting 03:03:30 (4757): No heartbeat from core client for 30 sec - exiting 03:03:31 (4757): No heartbeat from core client for 30 sec - exiting 03:03:32 (4757): No heartbeat from core client for 30 sec - exiting 03:03:33 (4757): No heartbeat from core client for 30 sec - exiting 03:03:34 (4757): No heartbeat from core client for 30 sec - exiting 03:03:35 (4757): No heartbeat from core client for 30 sec - exiting 03:03:36 (4757): No heartbeat from core client for 30 sec - exiting 03:03:37 (4757): No heartbeat from core client for 30 sec - exiting 03:03:38 (4757): No heartbeat from core client for 30 sec - exiting 03:03:39 (4757): No heartbeat from core client for 30 sec - exiting 03:03:40 (4757): No heartbeat from core client for 30 sec - exiting 03:03:41 (4757): No heartbeat from core client for 30 sec - exiting 03:03:42 (4757): No heartbeat from core client for 30 sec - exiting 03:03:43 (4757): No heartbeat from core client for 30 sec - exiting 03:03:44 (4757): No heartbeat from core client for 30 sec - exiting 03:03:45 (4757): No heartbeat from core client for 30 sec - exiting 03:03:46 (4757): No heartbeat from core client for 30 sec - exiting 03:03:47 (4757): No heartbeat from core client for 30 sec - exiting 03:03:48 (4757): No heartbeat from core client for 30 sec - exiting 03:03:49 (4757): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 10:40:31 (12231): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:43:02 (26479): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:43:03 (26479): No heartbeat from core client for 30 sec - exiting 10:43:04 (26479): No heartbeat from core client for 30 sec - exiting 10:43:05 (26479): No heartbeat from core client for 30 sec - exiting 10:43:06 (26479): No heartbeat from core client for 30 sec - exiting 10:43:07 (26479): No heartbeat from core client for 30 sec - exiting 10:43:08 (26479): No heartbeat from core client for 30 sec - exiting 10:43:09 (26479): No heartbeat from core client for 30 sec - exiting 10:43:10 (26479): No heartbeat from core client for 30 sec - exiting 10:43:11 (26479): No heartbeat from core client for 30 sec - exiting 10:43:12 (26479): No heartbeat from core client for 30 sec - exiting 10:43:13 (26479): No heartbeat from core client for 30 sec - exiting 10:43:14 (26479): No heartbeat from core client for 30 sec - exiting 10:43:15 (26479): No heartbeat from core client for 30 sec - exiting 10:43:16 (26479): No heartbeat from core client for 30 sec - exiting 10:43:17 (26479): No heartbeat from core client for 30 sec - exiting 10:43:18 (26479): No heartbeat from core client for 30 sec - exiting 10:43:19 (26479): No heartbeat from core client for 30 sec - exiting 10:43:20 (26479): No heartbeat from core client for 30 sec - exiting 10:43:21 (26479): No heartbeat from core client for 30 sec - exiting 10:43:22 (26479): No heartbeat from core client for 30 sec - exiting 10:43:23 (26479): No heartbeat from core client for 30 sec - exiting 10:43:24 (26479): No heartbeat from core client for 30 sec - exiting 10:43:25 (26479): No heartbeat from core client for 30 sec - exiting 10:43:26 (26479): No heartbeat from core client for 30 sec - exiting 10:43:27 (26479): No heartbeat from core client for 30 sec - exiting 10:43:28 (26479): No heartbeat from core client for 30 sec - exiting 10:43:29 (26479): No heartbeat from core client for 30 sec - exiting 10:43:30 (26479): No heartbeat from core client for 30 sec - exiting 10:43:31 (26479): No heartbeat from core client for 30 sec - exiting 10:43:32 (26479): No heartbeat from core client for 30 sec - exiting 10:43:33 (26479): No heartbeat from core client for 30 sec - exiting 10:43:34 (26479): No heartbeat from core client for 30 sec - exiting 10:43:35 (26479): No heartbeat from core client for 30 sec - exiting 10:43:36 (26479): No heartbeat from core client for 30 sec - exiting 10:43:37 (26479): No heartbeat from core client for 30 sec - exiting 10:43:38 (26479): No heartbeat from core client for 30 sec - exiting 10:43:39 (26479): No heartbeat from core client for 30 sec - exiting 10:43:40 (26479): No heartbeat from core client for 30 sec - exiting 10:43:41 (26479): No heartbeat from core client for 30 sec - exiting 10:43:42 (26479): No heartbeat from core client for 30 sec - exiting 10:43:43 (26479): No heartbeat from core client for 30 sec - exiting 10:43:44 (26479): No heartbeat from core client for 30 sec - exiting 10:43:45 (26479): No heartbeat from core client for 30 sec - exiting 10:43:46 (26479): No heartbeat from core client for 30 sec - exiting 10:43:47 (26479): No heartbeat from core client for 30 sec - exiting 10:43:48 (26479): No heartbeat from core client for 30 sec - exiting 10:43:49 (26479): No heartbeat from core client for 30 sec - exiting 10:43:50 (26479): No heartbeat from core client for 30 sec - exiting 10:43:51 (26479): No heartbeat from core client for 30 sec - exiting 10:43:52 (26479): No heartbeat from core client for 30 sec - exiting 10:43:53 (26479): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:31:38 (11587): No heartbeat from core client for 30 sec - exiting 00:31:39 (11587): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:20:40 (40421): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:07:19 (42764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:33:43 (63642): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:33:44 (63642): No heartbeat from core client for 30 sec - exiting 12:33:45 (63642): No heartbeat from core client for 30 sec - exiting 12:33:46 (63642): No heartbeat from core client for 30 sec - exiting 12:33:47 (63642): No heartbeat from core client for 30 sec - exiting 12:33:48 (63642): No heartbeat from core client for 30 sec - exiting SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.7 build 10J4138 Thu Jun 23 12:34:21 2011 Thread 0 Crashed: 0 libSystem.B.dylib 0x99b4017a __kill + 10 1 libSystem.B.dylib 0x99bd2879 raise + 26 2 libSystem.B.dylib 0x99be89b8 abort + 93 3 hadcm3n_um_6.07_i686-apple-darwin 0x00336cff um_setup + 127 4 hadcm3n_um_6.07_i686-apple-darwin 0x00389b71 um_shell + 3953 5 hadcm3n_um_6.07_i686-apple-darwin 0x000048e1 main + 1153 6 hadcm3n_um_6.07_i686-apple-darwin 0x000027fb _start + 209 7 hadcm3n_um_6.07_i686-apple-darwin 0x00002729 start + 41 Thread 1: 0 libSystem.B.dylib 0x99adf1ce mach_wait_until + 10 1 libSystem.B.dylib 0x99b66839 nanosleep + 345 2 libSystem.B.dylib 0x99b666da usleep + 61 3 hadcm3n_um_6.07_i686-apple-darwin 0x00442ec0 boinc_sleep(double) + 188 4 hadcm3n_um_6.07_i686-apple-darwin 0x0043865e timer_thread(void) + 78 5 libSystem.B.dylib 0x99b0c819 _pthread_start + 345 6 libSystem.B.dylib 0x99b0c69e thread_start + 34 Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc948 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x93b0d000 - 0x93b10fff /usr/lib/system/libmathCommon.A.dylib 0x93dda000 - 0x93de8fff /usr/lib/libz.1.dylib 0x99ade000 - 0x99c85fff /usr/lib/libSystem.B.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=63854, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.7 build 10J4138 Thu Jun 23 12:34:27 2011 Thread 0 Crashed: 0 libSystem.B.dylib 0x99b4017a __kill + 10 1 libSystem.B.dylib 0x99bd2879 raise + 26 2 libSystem.B.dylib 0x99be89b8 abort + 93 3 hadcm3n_um_6.07_i686-apple-darwin 0x00336cff um_setup + 127 4 hadcm3n_um_6.07_i686-apple-darwin 0x00389b71 um_shell + 3953 5 hadcm3n_um_6.07_i686-apple-darwin 0x000048e1 main + 1153 6 hadcm3n_um_6.07_i686-apple-darwin 0x000027fb _start + 209 7 hadcm3n_um_6.07_i686-apple-darwin 0x00002729 start + 41 Thread 1: 0 libSystem.B.dylib 0x99adf1ce mach_wait_until + 10 1 libSystem.B.dylib 0x99b66839 nanosleep + 345 2 libSystem.B.dylib 0x99b666da usleep + 61 3 hadcm3n_um_6.07_i686-apple-darwin 0x00442ec0 boinc_sleep(double) + 188 4 hadcm3n_um_6.07_i686-apple-darwin 0x0043865e timer_thread(void) + 78 5 libSystem.B.dylib 0x99b0c819 _pthread_start + 345 6 libSystem.B.dylib 0x99b0c69e thread_start + 34 Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc948 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x93b0d000 - 0x93b10fff /usr/lib/system/libmathCommon.A.dylib 0x93dda000 - 0x93de8fff /usr/lib/libz.1.dylib 0x99ade000 - 0x99c85fff /usr/lib/libSystem.B.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=63854, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.7 build 10J4138 Thu Jun 23 12:34:30 2011 Thread 0 Crashed: 0 libSystem.B.dylib 0x99b4017a __kill + 10 1 libSystem.B.dylib 0x99bd2879 raise + 26 2 libSystem.B.dylib 0x99be89b8 abort + 93 3 hadcm3n_um_6.07_i686-apple-darwin 0x00336cff um_setup + 127 4 hadcm3n_um_6.07_i686-apple-darwin 0x00389b71 um_shell + 3953 5 hadcm3n_um_6.07_i686-apple-darwin 0x000048e1 main + 1153 6 hadcm3n_um_6.07_i686-apple-darwin 0x000027fb _start + 209 7 hadcm3n_um_6.07_i686-apple-darwin 0x00002729 start + 41 Thread 1: 0 libSystem.B.dylib 0x99adf1ce mach_wait_until + 10 1 libSystem.B.dylib 0x99b66839 nanosleep + 345 2 libSystem.B.dylib 0x99b666da usleep + 61 3 hadcm3n_um_6.07_i686-apple-darwin 0x00442ec0 boinc_sleep(double) + 188 4 hadcm3n_um_6.07_i686-apple-darwin 0x0043865e timer_thread(void) + 78 5 libSystem.B.dylib 0x99b0c819 _pthread_start + 345 6 libSystem.B.dylib 0x99b0c69e thread_start + 34 Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc948 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x93b0d000 - 0x93b10fff /usr/lib/system/libmathCommon.A.dylib 0x93dda000 - 0x93de8fff /usr/lib/libz.1.dylib 0x99ade000 - 0x99c85fff /usr/lib/libSystem.B.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=63854, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.7 build 10J4138 Thu Jun 23 12:34:33 2011 Thread 0 Crashed: 0 libSystem.B.dylib 0x99b4017a __kill + 10 1 libSystem.B.dylib 0x99bd2879 raise + 26 2 libSystem.B.dylib 0x99be89b8 abort + 93 3 hadcm3n_um_6.07_i686-apple-darwin 0x00336cff um_setup + 127 4 hadcm3n_um_6.07_i686-apple-darwin 0x00389b71 um_shell + 3953 5 hadcm3n_um_6.07_i686-apple-darwin 0x000048e1 main + 1153 6 hadcm3n_um_6.07_i686-apple-darwin 0x000027fb _start + 209 7 hadcm3n_um_6.07_i686-apple-darwin 0x00002729 start + 41 Thread 1: 0 libSystem.B.dylib 0x99adf1ce mach_wait_until + 10 1 libSystem.B.dylib 0x99b66839 nanosleep + 345 2 libSystem.B.dylib 0x99b666da usleep + 61 3 hadcm3n_um_6.07_i686-apple-darwin 0x00442ec0 boinc_sleep(double) + 188 4 hadcm3n_um_6.07_i686-apple-darwin 0x0043865e timer_thread(void) + 78 5 libSystem.B.dylib 0x99b0c819 _pthread_start + 345 6 libSystem.B.dylib 0x99b0c69e thread_start + 34 Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc948 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x93b0d000 - 0x93b10fff /usr/lib/system/libmathCommon.A.dylib 0x93dda000 - 0x93de8fff /usr/lib/libz.1.dylib 0x99ade000 - 0x99c85fff /usr/lib/libSystem.B.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=63854, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.7 build 10J4138 Thu Jun 23 12:34:35 2011 Thread 0 Crashed: 0 libSystem.B.dylib 0x99b4017a __kill + 10 1 libSystem.B.dylib 0x99bd2879 raise + 26 2 libSystem.B.dylib 0x99be89b8 abort + 93 3 hadcm3n_um_6.07_i686-apple-darwin 0x00336cff um_setup + 127 4 hadcm3n_um_6.07_i686-apple-darwin 0x00389b71 um_shell + 3953 5 hadcm3n_um_6.07_i686-apple-darwin 0x000048e1 main + 1153 6 hadcm3n_um_6.07_i686-apple-darwin 0x000027fb _start + 209 7 hadcm3n_um_6.07_i686-apple-darwin 0x00002729 start + 41 Thread 1: 0 libSystem.B.dylib 0x99adf1ce mach_wait_until + 10 1 libSystem.B.dylib 0x99b66839 nanosleep + 345 2 libSystem.B.dylib 0x99b666da usleep + 61 3 hadcm3n_um_6.07_i686-apple-darwin 0x00442ec0 boinc_sleep(double) + 188 4 hadcm3n_um_6.07_i686-apple-darwin 0x0043865e timer_thread(void) + 78 5 libSystem.B.dylib 0x99b0c819 _pthread_start + 345 6 libSystem.B.dylib 0x99b0c69e thread_start + 34 Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc948 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x93b0d000 - 0x93b10fff /usr/lib/system/libmathCommon.A.dylib 0x93dda000 - 0x93de8fff /usr/lib/libz.1.dylib 0x99ade000 - 0x99c85fff /usr/lib/libSystem.B.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=63854, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.7 build 10J4138 Thu Jun 23 12:34:38 2011 Thread 0 Crashed: CPDN Monitor - Quit request from BOINC... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.7 build 10J4138 Thu Jun 23 13:55:12 2011 Thread 0 Crashed: 0 libSystem.B.dylib 0x99b4017a __kill + 10 1 libSystem.B.dylib 0x99bd2879 raise + 26 2 libSystem.B.dylib 0x99be89b8 abort + 93 3 hadcm3n_um_6.07_i686-apple-darwin 0x00336cff um_setup + 127 4 hadcm3n_um_6.07_i686-apple-darwin 0x00389b71 um_shell + 3953 5 hadcm3n_um_6.07_i686-apple-darwin 0x000048e1 main + 1153 6 hadcm3n_um_6.07_i686-apple-darwin 0x000027fb _start + 209 7 hadcm3n_um_6.07_i686-apple-darwin 0x00002729 start + 41 Thread 1: 0 libSystem.B.dylib 0x99adf1ce mach_wait_until + 10 1 libSystem.B.dylib 0x99b66839 nanosleep + 345 2 libSystem.B.dylib 0x99b666da usleep + 61 3 hadcm3n_um_6.07_i686-apple-darwin 0x00442ec0 boinc_sleep(double) + 188 4 hadcm3n_um_6.07_i686-apple-darwin 0x0043865e timer_thread(void) + 78 5 libSystem.B.dylib 0x99b0c819 _pthread_start + 345 6 libSystem.B.dylib 0x99b0c69e thread_start + 34 Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc948 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x93b0d000 - 0x93b10fff /usr/lib/system/libmathCommon.A.dylib 0x93dda000 - 0x93de8fff /usr/lib/libz.1.dylib 0x99ade000 - 0x99c85fff /usr/lib/libSystem.B.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=64662, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Jun 2011 05:00:55	1136618	12929114	hadcm3n_o18j_1940_40_007267728_0	466,560	579,501	1.2421
19 Jun 2011 22:59:52	1136618	12929114	hadcm3n_o18j_1940_40_007267728_0	440,640	539,387	1.2241
15 Jun 2011 23:37:32	1136618	12929114	hadcm3n_o18j_1940_40_007267728_0	414,720	501,166	1.2084
14 Jun 2011 15:19:24	1136618	12929114	hadcm3n_o18j_1940_40_007267728_0	388,800	469,652	1.2080
14 Jun 2011 04:50:16	1136618	12929114	hadcm3n_o18j_1940_40_007267728_0	362,880	443,113	1.2211
13 Jun 2011 17:41:17	1136618	12929114	hadcm3n_o18j_1940_40_007267728_0	336,960	421,615	1.2512
13 Jun 2011 08:08:55	1136618	12929114	hadcm3n_o18j_1940_40_007267728_0	311,040	398,823	1.2822
12 Jun 2011 21:40:10	1136618	12929114	hadcm3n_o18j_1940_40_007267728_0	285,120	368,630	1.2929
12 Jun 2011 13:44:58	1136618	12929114	hadcm3n_o18j_1940_40_007267728_0	259,200	345,472	1.3328
12 Jun 2011 05:04:30	1136618	12929114	hadcm3n_o18j_1940_40_007267728_0	233,280	322,618	1.3830
11 Jun 2011 20:12:28	1136618	12929114	hadcm3n_o18j_1940_40_007267728_0	207,360	298,790	1.4409
11 Jun 2011 07:30:07	1136618	12929114	hadcm3n_o18j_1940_40_007267728_0	181,440	262,411	1.4463
10 Jun 2011 19:42:18	1136618	12929114	hadcm3n_o18j_1940_40_007267728_0	155,520	225,238	1.4483
10 Jun 2011 08:08:36	1136618	12929114	hadcm3n_o18j_1940_40_007267728_0	129,600	189,155	1.4595
09 Jun 2011 19:15:52	1136618	12929114	hadcm3n_o18j_1940_40_007267728_0	103,680	151,778	1.4639
09 Jun 2011 04:39:15	1136618	12929114	hadcm3n_o18j_1940_40_007267728_0	77,760	114,269	1.4695
08 Jun 2011 10:42:08	1136618	12929114	hadcm3n_o18j_1940_40_007267728_0	51,840	76,839	1.4822
07 Jun 2011 23:53:15	1136618	12929114	hadcm3n_o18j_1940_40_007267728_0	25,920	39,649	1.5297