climateprediction.net home page
Task 16217376

Task 16217376

Name hadcm3n_7ad9_1980_40_008424720_1
Workunit 8575576
Created 13 Jan 2014, 23:00:10 UTC
Sent 13 Jan 2014, 23:01:30 UTC
Report deadline 15 Apr 2014, 6:28:41 UTC
Received 4 Mar 2014, 3:00:16 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1231328
Run time 27 days 15 hours 40 min 8 sec
CPU time 16 days 13 hours 6 min 51 sec
Validate state Invalid
Credit 9,331.20
Device peak FLOPS 3.00 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-apple-darwin
Stderr
<core_client_version>7.2.39</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
19:38:39 (23033): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:30:25 (23700): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:30:30 (23700): No heartbeat from core client for 30 sec - exiting
07:30:31 (23700): No heartbeat from core client for 30 sec - exiting
07:32:52 (28469): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
21:20:47 (63858): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:56:22 (65187): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:56:26 (65187): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
19:03:32 (73584): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:48:36 (74015): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
01:27:48 (10221): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:27:51 (10221): No heartbeat from core client for 30 sec - exiting
01:27:52 (10221): No heartbeat from core client for 30 sec - exiting
01:27:53 (10221): No heartbeat from core client for 30 sec - exiting
01:27:54 (10221): No heartbeat from core client for 30 sec - exiting
01:27:55 (10221): No heartbeat from core client for 30 sec - exiting
01:27:56 (10221): No heartbeat from core client for 30 sec - exiting
01:27:57 (10221): No heartbeat from core client for 30 sec - exiting
02:29:17 (13222): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:29:18 (13222): No heartbeat from core client for 30 sec - exiting
02:29:19 (13222): No heartbeat from core client for 30 sec - exiting
02:29:20 (13222): No heartbeat from core client for 30 sec - exiting
02:29:21 (13222): No heartbeat from core client for 30 sec - exiting
02:29:22 (13222): No heartbeat from core client for 30 sec - exiting
02:29:23 (13222): No heartbeat from core client for 30 sec - exiting
02:29:24 (13222): No heartbeat from core client for 30 sec - exiting
02:29:25 (13222): No heartbeat from core client for 30 sec - exiting
02:29:26 (13222): No heartbeat from core client for 30 sec - exiting
02:29:27 (13222): No heartbeat from core client for 30 sec - exiting
02:29:28 (13222): No heartbeat from core client for 30 sec - exiting
02:29:29 (13222): No heartbeat from core client for 30 sec - exiting
02:29:30 (13222): No heartbeat from core client for 30 sec - exiting
02:29:31 (13222): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
22:51:45 (13733): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
05:29:30 (31722): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:29:31 (31722): No heartbeat from core client for 30 sec - exiting
05:29:32 (31722): No heartbeat from core client for 30 sec - exiting
05:29:33 (31722): No heartbeat from core client for 30 sec - exiting
05:29:34 (31722): No heartbeat from core client for 30 sec - exiting
05:29:35 (31722): No heartbeat from core client for 30 sec - exiting
05:29:36 (31722): No heartbeat from core client for 30 sec - exiting
05:29:37 (31722): No heartbeat from core client for 30 sec - exiting
05:29:38 (31722): No heartbeat from core client for 30 sec - exiting
05:29:39 (31722): No heartbeat from core client for 30 sec - exiting
05:29:40 (31722): No heartbeat from core client for 30 sec - exiting
05:29:41 (31722): No heartbeat from core client for 30 sec - exiting
05:29:42 (31722): No heartbeat from core client for 30 sec - exiting
05:29:43 (31722): No heartbeat from core client for 30 sec - exiting
05:29:44 (31722): No heartbeat from core client for 30 sec - exiting
05:29:45 (31722): No heartbeat from core client for 30 sec - exiting
05:29:46 (31722): No heartbeat from core client for 30 sec - exiting
05:29:47 (31722): No heartbeat from core client for 30 sec - exiting
05:29:48 (31722): No heartbeat from core client for 30 sec - exiting
05:29:49 (31722): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
hadcm3n_6.07_i686-apple-darwin(57960,0xa06c8540) malloc: *** error for object 0x483c004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(57960,0xa06c8540) malloc: *** error for object 0x483c000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(57960,0xa06c8540) malloc: *** error for object 0x3820404: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(57960,0xa06c8540) malloc: *** error for object 0x3820400: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(57960,0xa06c8540) malloc: *** error for object 0x858604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(57960,0xa06c8540) malloc: *** error for object 0x4036004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(57960,0xa06c8540) malloc: *** error for object 0x4820a04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(57960,0xa06c8540) malloc: *** error for object 0x483c004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(57960,0xa06c8540) malloc: *** error for object 0x483c000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(57960,0xa06c8540) malloc: *** error for object 0x3800e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(57960,0xa06c8540) malloc: *** error for object 0x3800e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(57960,0xa06c8540) malloc: *** error for object 0x4803004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(57960,0xa06c8540) malloc: *** error for object 0x4803000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(57960,0xa06c8540) malloc: *** error for object 0x4803004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(57960,0xa06c8540) malloc: *** error for object 0x4803000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(57960,0xa06c8540) malloc: *** error for object 0x4803004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(57960,0xa06c8540) malloc: *** error for object 0x4803000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(57960,0xa06c8540) malloc: *** error for object 0x4803004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(57960,0xa06c8540) malloc: *** error for object 0x4803000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(57960,0xa06c8540) malloc: *** error for object 0x4803000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(68453,0xa06c8540) malloc: *** error for object 0x1034604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(68453,0xa06c8540) malloc: *** error for object 0x381f604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(68453,0xa06c8540) malloc: *** error for object 0x3805c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(68453,0xa06c8540) malloc: *** error for object 0x3805c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(68453,0xa06c8540) malloc: *** error for object 0x4835204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(68453,0xa06c8540) malloc: *** error for object 0x4835200: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(68453,0xa06c8540) malloc: *** error for object 0x4835204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(68453,0xa06c8540) malloc: *** error for object 0x4835200: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(68453,0xa06c8540) malloc: *** error for object 0x4835204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(68453,0xa06c8540) malloc: *** error for object 0x4835200: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(68453,0xa06c8540) malloc: *** error for object 0x4835204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(68453,0xa06c8540) malloc: *** error for object 0x4835200: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(68453,0xa06c8540) malloc: *** error for object 0x4835204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation

Crashed executable name: hadcm3n_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.8 build 10K549
Mon Mar  3 18:00:04 2014

Thread 0 Crashed:
atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386.
0   libSystem.B.dylib                   0x95678b03 small_free_list_remove_ptr + 234
1   libSystem.B.dylib                   0x956755cc szone_free_definite_size + 3457
2   libSystem.B.dylib                   0x956745e8 free + 244
3   hadcm3n_6.07_i686-apple-darwin      0x0000ba58 annual_cycle(std::vector<std::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::basic_string<char, std::char_traits<char>, std::allocator<char> > > > const*, char const*, int, int) + 3482
4   hadcm3n_6.07_i686-apple-darwin      0x0000d36b decadalMeans(int, char const*) + 957
5   hadcm3n_6.07_i686-apple-darwin      0x000067ff doCM3Proc() + 185
6   hadcm3n_6.07_i686-apple-darwin      0x0000876a worker() + 2896
7   hadcm3n_6.07_i686-apple-darwin      0x00008aa9 main + 491
8   hadcm3n_6.07_i686-apple-darwin      0x00002676 start + 54

Thread 1:
0   libSystem.B.dylib                   0x9566dc0e mach_wait_until + 10
1   libSystem.B.dylib                   0x956f5429 nanosleep + 345
2   libSystem.B.dylib                   0x956f52ca usleep + 61
3   hadcm3n_6.07_i686-apple-darwin      0x00071a7c boinc_sleep(double) + 188
4   hadcm3n_6.07_i686-apple-darwin      0x00067282 timer_thread(void*) + 78
5   libSystem.B.dylib                   0x9569b259 _pthread_start + 345
6   libSystem.B.dylib                   0x9569b0de thread_start + 34

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8f248 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -    0x93fff /Library/Application Support/BOINC Data/slots/6/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin
0x9566d000 - 0x95814fff /usr/lib/libSystem.B.dylib
0x95f96000 - 0x95fa4fff /usr/lib/libz.1.dylib
0x9676f000 - 0x967d9fff /usr/lib/libstdc++.6.dylib
0x967da000 - 0x967ddfff /usr/lib/system/libmathCommon.A.dylib


Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
03 Mar 2014 03:56:56 1231328 16217376 hadcm3n_7ad9_1980_40_008424720_1 777,600 1,399,343 1.7996
01 Mar 2014 11:39:36 1231328 16217376 hadcm3n_7ad9_1980_40_008424720_1 751,680 1,355,585 1.8034
28 Feb 2014 05:05:45 1231328 16217376 hadcm3n_7ad9_1980_40_008424720_1 725,760 1,311,485 1.8071
26 Feb 2014 12:35:25 1231328 16217376 hadcm3n_7ad9_1980_40_008424720_1 699,840 1,267,379 1.8110
25 Feb 2014 05:23:53 1231328 16217376 hadcm3n_7ad9_1980_40_008424720_1 673,920 1,223,200 1.8151
23 Feb 2014 11:51:09 1231328 16217376 hadcm3n_7ad9_1980_40_008424720_1 648,000 1,179,138 1.8197
22 Feb 2014 06:22:14 1231328 16217376 hadcm3n_7ad9_1980_40_008424720_1 622,080 1,135,498 1.8253
20 Feb 2014 14:02:36 1231328 16217376 hadcm3n_7ad9_1980_40_008424720_1 596,160 1,091,447 1.8308
19 Feb 2014 08:37:38 1231328 16217376 hadcm3n_7ad9_1980_40_008424720_1 570,240 1,047,862 1.8376
18 Feb 2014 12:01:30 1231328 16217376 hadcm3n_7ad9_1980_40_008424720_1 544,320 1,003,985 1.8445
15 Feb 2014 10:47:04 1231328 16217376 hadcm3n_7ad9_1980_40_008424720_1 518,400 959,562 1.8510
14 Feb 2014 04:40:17 1231328 16217376 hadcm3n_7ad9_1980_40_008424720_1 492,480 915,389 1.8587
12 Feb 2014 12:27:09 1231328 16217376 hadcm3n_7ad9_1980_40_008424720_1 466,560 871,030 1.8669
11 Feb 2014 06:25:30 1231328 16217376 hadcm3n_7ad9_1980_40_008424720_1 440,640 826,591 1.8759
09 Feb 2014 10:30:57 1231328 16217376 hadcm3n_7ad9_1980_40_008424720_1 414,720 778,501 1.8772
07 Feb 2014 14:51:48 1231328 16217376 hadcm3n_7ad9_1980_40_008424720_1 388,800 729,085 1.8752
06 Feb 2014 05:39:54 1231328 16217376 hadcm3n_7ad9_1980_40_008424720_1 362,880 679,815 1.8734
04 Feb 2014 10:39:23 1231328 16217376 hadcm3n_7ad9_1980_40_008424720_1 336,960 631,376 1.8737
02 Feb 2014 15:49:02 1231328 16217376 hadcm3n_7ad9_1980_40_008424720_1 311,040 582,920 1.8741
01 Feb 2014 05:16:09 1231328 16217376 hadcm3n_7ad9_1980_40_008424720_1 285,120 533,294 1.8704


©2024 cpdn.org