climateprediction.net home page
Task 12821849

Task 12821849

Name hadcm3n_p2lv_1900_40_007220963_1
Workunit 7419203
Created 26 Apr 2011, 15:21:40 UTC
Sent 2 May 2011, 5:44:59 UTC
Report deadline 1 Aug 2011, 13:12:10 UTC
Received 7 May 2011, 22:26:29 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1139329
Run time 4 days 14 hours 10 min 54 sec
CPU time 4 days 11 hours 1 min 13 sec
Validate state Invalid
Credit 3,110.40
Device peak FLOPS 3.54 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-apple-darwin
Stderr 
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
05:07:41 (2439): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:07:42 (2439): No heartbeat from core client for 30 sec - exiting
05:07:43 (2439): No heartbeat from core client for 30 sec - exiting
05:07:44 (2439): No heartbeat from core client for 30 sec - exiting
05:07:45 (2439): No heartbeat from core client for 30 sec - exiting
05:07:46 (2439): No heartbeat from core client for 30 sec - exiting
05:07:47 (2439): No heartbeat from core client for 30 sec - exiting
05:07:48 (2439): No heartbeat from core client for 30 sec - exiting
05:07:49 (2439): No heartbeat from core client for 30 sec - exiting
05:07:50 (2439): No heartbeat from core client for 30 sec - exiting
05:07:51 (2439): No heartbeat from core client for 30 sec - exiting
05:07:52 (2439): No heartbeat from core client for 30 sec - exiting
05:07:53 (2439): No heartbeat from core client for 30 sec - exiting
05:07:54 (2439): No heartbeat from core client for 30 sec - exiting
05:07:55 (2439): No heartbeat from core client for 30 sec - exiting
05:07:56 (2439): No heartbeat from core client for 30 sec - exiting
05:07:57 (2439): No heartbeat from core client for 30 sec - exiting
05:07:58 (2439): No heartbeat from core client for 30 sec - exiting
05:07:59 (2439): No heartbeat from core client for 30 sec - exiting
05:08:00 (2439): No heartbeat from core client for 30 sec - exiting
05:08:01 (2439): No heartbeat from core client for 30 sec - exiting
05:08:02 (2439): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
19:55:24 (468): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:55:25 (468): No heartbeat from core client for 30 sec - exiting
19:55:26 (468): No heartbeat from core client for 30 sec - exiting
19:55:27 (468): No heartbeat from core client for 30 sec - exiting
19:55:28 (468): No heartbeat from core client for 30 sec - exiting
19:55:29 (468): No heartbeat from core client for 30 sec - exiting
19:55:30 (468): No heartbeat from core client for 30 sec - exiting
19:55:31 (468): No heartbeat from core client for 30 sec - exiting
19:55:32 (468): No heartbeat from core client for 30 sec - exiting
19:55:33 (468): No heartbeat from core client for 30 sec - exiting
19:55:34 (468): No heartbeat from core client for 30 sec - exiting
19:55:35 (468): No heartbeat from core client for 30 sec - exiting
19:55:36 (468): No heartbeat from core client for 30 sec - exiting
19:55:37 (468): No heartbeat from core client for 30 sec - exiting
19:55:38 (468): No heartbeat from core client for 30 sec - exiting
19:55:39 (468): No heartbeat from core client for 30 sec - exiting
19:55:40 (468): No heartbeat from core client for 30 sec - exiting
19:55:41 (468): No heartbeat from core client for 30 sec - exiting
19:55:42 (468): No heartbeat from core client for 30 sec - exiting
19:55:43 (468): No heartbeat from core client for 30 sec - exiting
19:55:44 (468): No heartbeat from core client for 30 sec - exiting
19:55:45 (468): No heartbeat from core client for 30 sec - exiting
19:55:46 (468): No heartbeat from core client for 30 sec - exiting
19:55:47 (468): No heartbeat from core client for 30 sec - exiting
19:55:48 (468): No heartbeat from core client for 30 sec - exiting
19:55:49 (468): No heartbeat from core client for 30 sec - exiting
19:55:50 (468): No heartbeat from core client for 30 sec - exiting
19:55:51 (468): No heartbeat from core client for 30 sec - exiting
19:55:52 (468): No heartbeat from core client for 30 sec - exiting
19:55:53 (468): No heartbeat from core client for 30 sec - exiting
19:55:54 (468): No heartbeat from core client for 30 sec - exiting
19:55:55 (468): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
hadcm3n_6.07_i686-apple-darwin(31014,0xa050b540) malloc: *** error for object 0x3001c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(31014,0xa050b540) malloc: *** error for object 0x3001c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(31014,0xa050b540) malloc: *** error for object 0x3001c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(31014,0xa050b540) malloc: *** error for object 0x3001c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(31014,0xa050b540) malloc: *** error for object 0x3001c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(31014,0xa050b540) malloc: *** error for object 0x3001c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(31014,0xa050b540) malloc: *** error for object 0x3001c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(31014,0xa050b540) malloc: *** error for object 0x3001c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(31014,0xa050b540) malloc: *** error for object 0x3001c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(31014,0xa050b540) malloc: *** error for object 0x3001c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(31014,0xa050b540) malloc: *** error for object 0x6804e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation

Crashed executable name: hadcm3n_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.7 build 10J869
Sun May  8 00:24:44 2011

Thread 0 Crashed:
atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386.
0   libSystem.B.dylib                   0x945070af small_free_list_remove_ptr + 246
1   libSystem.B.dylib                   0x94503b6c szone_free_definite_size + 3457
2   libSystem.B.dylib                   0x94502b88 free + 244
3   hadcm3n_6.07_i686-apple-darwin      0x00022341 ncio_px_free + 97
4   hadcm3n_6.07_i686-apple-darwin      0x0002290c ncio_free + 28
5   hadcm3n_6.07_i686-apple-darwin      0x00022f09 ncio_close + 57
6   hadcm3n_6.07_i686-apple-darwin      0x0001cdd7 nc_close + 103
7   hadcm3n_6.07_i686-apple-darwin      0x0000bab9 annual_cycle(std::vector<std::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::basic_string<char, std::char_traits<char>, std::allocator<char> > > > const*, char const*, int, int) + 3579
8   hadcm3n_6.07_i686-apple-darwin      0x0000d36b decadalMeans(int, char const*) + 957
9   hadcm3n_6.07_i686-apple-darwin      0x000067ff doCM3Proc() + 185
10  hadcm3n_6.07_i686-apple-darwin      0x0000791c mainLoop() + 410
11  hadcm3n_6.07_i686-apple-darwin      0x000087c7 worker() + 2989
12  hadcm3n_6.07_i686-apple-darwin      0x00008aa9 main + 491
13  hadcm3n_6.07_i686-apple-darwin      0x00002676 start + 54

Thread 1:
0   libSystem.B.dylib                   0x944fc1ae mach_wait_until + 10
1   libSystem.B.dylib                   0x94583809 nanosleep + 345
2   libSystem.B.dylib                   0x945836aa usleep + 61
3   hadcm3n_6.07_i686-apple-darwin      0x00071a7c boinc_sleep(double) + 188
4   hadcm3n_6.07_i686-apple-darwin      0x00067282 timer_thread(void*) + 78
5   libSystem.B.dylib                   0x945297fd _pthread_start + 345
6   libSystem.B.dylib                   0x94529682 thread_start + 34

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8f728 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -    0x93fff /Library/Application Support/BOINC Data/slots/11/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin
0x91e3a000 - 0x91e48fff /usr/lib/libz.1.dylib
0x928a3000 - 0x9290dfff /usr/lib/libstdc++.6.dylib
0x94029000 - 0x9402cfff /usr/lib/system/libmathCommon.A.dylib
0x944fb000 - 0x946a2fff /usr/lib/libSystem.B.dylib


Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
07 May 2011 22:26:31 1139329 12821849 hadcm3n_p2lv_1900_40_007220963_1 259,200 385,270 1.4864
07 May 2011 11:59:39 1139329 12821849 hadcm3n_p2lv_1900_40_007220963_1 233,280 353,432 1.5151
07 May 2011 02:43:22 1139329 12821849 hadcm3n_p2lv_1900_40_007220963_1 207,360 320,656 1.5464
06 May 2011 07:38:34 1139329 12821849 hadcm3n_p2lv_1900_40_007220963_1 181,440 287,384 1.5839
05 May 2011 21:32:48 1139329 12821849 hadcm3n_p2lv_1900_40_007220963_1 155,520 251,810 1.6191
05 May 2011 04:07:16 1139329 12821849 hadcm3n_p2lv_1900_40_007220963_1 129,600 214,395 1.6543
04 May 2011 10:28:43 1139329 12821849 hadcm3n_p2lv_1900_40_007220963_1 103,680 171,759 1.6566
03 May 2011 21:48:43 1139329 12821849 hadcm3n_p2lv_1900_40_007220963_1 77,760 128,682 1.6549
03 May 2011 08:18:53 1139329 12821849 hadcm3n_p2lv_1900_40_007220963_1 51,840 85,738 1.6539
02 May 2011 19:56:14 1139329 12821849 hadcm3n_p2lv_1900_40_007220963_1 25,920 42,822 1.6521


©2024 climateprediction.net